2023-01-24T21:28:25.860 INFO:root:teuthology version: 0.0.1.dev22+g8e1bba1 2023-01-24T21:28:25.861 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2023-01-24_16:05:13-rados-wip-yuri7-testing-2023-01-23-1532-quincy-distro-default-smithi --verbose --description rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} --archive /home/teuthworker/archive/yuriw-2023-01-24_16:05:13-rados-wip-yuri7-testing-2023-01-23-1532-quincy-distro-default-smithi/7135830 --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-01-24_16:05:13-rados-wip-yuri7-testing-2023-01-23-1532-quincy-distro-default-smithi/7135830/orig.config.yaml 2023-01-24T21:28:25.898 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-01-24T21:28:25.964 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-01-24_16:05:13-rados-wip-yuri7-testing-2023-01-23-1532-quincy-distro-default-smithi/7135830 branch: wip-yuri7-testing-2023-01-23-1532-quincy description: rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} email: yweinstein@radhat.com first_in_suite: false job_id: '7135830' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2023-01-24_16:05:13-rados-wip-yuri7-testing-2023-01-23-1532-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri7-testing-2023-01-23-1532-quincy ceph: conf: global: mon election default strategy: 1 ms bind msgr2: false ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) mon_bind_msgr2: false sha1: 49f8fb05584886826e8eade75f7105fba754560c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 49f8fb05584886826e8eade75f7105fba754560c selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri7-testing-2023-01-23-1532-quincy sha1: 49f8fb05584886826e8eade75f7105fba754560c owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - osd.0 - osd.1 - osd.2 - client.0 sha1: 49f8fb05584886826e8eade75f7105fba754560c sleep_before_teardown: 0 suite: rados suite_branch: wip-yuri7-testing-2023-01-23-1532-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_49f8fb05584886826e8eade75f7105fba754560c/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 49f8fb05584886826e8eade75f7105fba754560c targets: smithi007.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDzT0EiDZGSIf7d+GRcvr1nI6p3YOzeNS9I2cu28BGneksDPUfcVJCKP0tNO7ytdjrH2AyJCiS+MbmosD1tq2EE4fijIIbtodPDKgO9hUWl+F1JNWLXC15VvqB3tEzeDhx5qATf0sSszhL4Qx+OZTpTx169ZwzNB1PpnhmAz/dl3iHxIxnzOhCgGiEH4oq26tNcdNrVCAhUua0ogCaLn7Q78L3sXq55DLf9XvUB3nUoJbAMFx2uPiKWqZJM60inYnrNnW0pSxXLYPQJOYx0yvMAy8hFUfYluuX6ffK8BBTbHbq+WFzRHHDn1M6BJfVHpLhg4OUkRQ7SZHtkMhewBtBG7TZrKRUru1nTROSFbS0/PqQvU2KXrQdfsXDGwVtyQ18bwg18fwg+iXwu+4Xwk5Kl2S49g6nTfFa/8kZsClv6NKn2P+O7Zgo2IAVLwZwYeBL4Yy2Z19PDQVcM4QHH6FFt6nrvtr45YsujIixapI7sGX4nWUElDI5kd1AUtQjeLKU= tasks: - install: null - ceph: log-ignorelist: - but it is still running - had wrong client addr - had wrong cluster addr - must scrub before tier agent can activate - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping updates - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(SMALLER_PG_NUM\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(FS_WITH_FAILED_MDS\) - \(FS_DEGRADED\) - \(POOL_BACKFILLFULL\) - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(POOL_NEARFULL\) - \(POOL_APP_NOT_ENABLED\) - \(AUTH_BAD_CAPS\) - \(FS_INLINE_DATA_DEPRECATED\) - \(MON_DOWN\) - \(SLOW_OPS\) - slow request - workunit: clients: all: - cephtool - mon/pool_ops.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8e1bba12e584b7ae912e92e94afe9c075ab51fa3 timestamp: 2023-01-24_16:05:13 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.17735 2023-01-24T21:28:25.965 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_49f8fb05584886826e8eade75f7105fba754560c/qa; will attempt to use it 2023-01-24T21:28:25.966 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_49f8fb05584886826e8eade75f7105fba754560c/qa/tasks 2023-01-24T21:28:25.966 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-01-24T21:28:25.968 INFO:teuthology.task.internal:Checking packages... 2023-01-24T21:28:25.995 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '49f8fb05584886826e8eade75f7105fba754560c' 2023-01-24T21:28:25.995 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-01-24T21:28:25.996 INFO:teuthology.packaging:ref: None 2023-01-24T21:28:25.996 INFO:teuthology.packaging:tag: None 2023-01-24T21:28:25.996 INFO:teuthology.packaging:branch: wip-yuri7-testing-2023-01-23-1532-quincy 2023-01-24T21:28:25.997 INFO:teuthology.packaging:sha1: 49f8fb05584886826e8eade75f7105fba754560c 2023-01-24T21:28:25.997 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri7-testing-2023-01-23-1532-quincy 2023-01-24T21:28:26.144 INFO:teuthology.task.internal:Found packages for ceph version 17.2.5-727.g49f8fb05 2023-01-24T21:28:26.144 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-01-24T21:28:26.151 INFO:teuthology.task.internal:no buildpackages task found 2023-01-24T21:28:26.151 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-01-24T21:28:26.171 INFO:teuthology.task.internal:Saving configuration 2023-01-24T21:28:26.185 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-01-24T21:28:26.192 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-01-24T21:28:26.221 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-01-24_16:05:13-rados-wip-yuri7-testing-2023-01-23-1532-quincy-distro-default-smithi/7135830', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-24 21:23:45.762046', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC0xIcjaoxHjO84O0fmE0caZX0CexipbR+8zvwPEGZsw28/3BhLq9rN1ZyFm87QORJAPAcElL6bwGqCG8nSxKDM='} 2023-01-24T21:28:26.221 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-01-24T21:28:26.227 INFO:teuthology.task.internal:roles: ubuntu@smithi007.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2023-01-24T21:28:26.227 INFO:teuthology.run_tasks:Running task console_log... 2023-01-24T21:28:26.269 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8be1edc5e0>, signals=[15]) 2023-01-24T21:28:26.270 INFO:teuthology.run_tasks:Running task internal.connect... 2023-01-24T21:28:26.278 INFO:teuthology.task.internal:Opening connections... 2023-01-24T21:28:26.278 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi007.front.sepia.ceph.com 2023-01-24T21:28:26.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-24T21:28:26.350 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-01-24T21:28:26.363 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2023-01-24T21:28:26.381 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2023-01-24T21:28:26.382 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2023-01-24T21:28:26.438 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="Red Hat Enterprise Linux" 2023-01-24T21:28:26.438 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="8.4 (Ootpa)" 2023-01-24T21:28:26.439 INFO:teuthology.orchestra.run.smithi007.stdout:ID="rhel" 2023-01-24T21:28:26.439 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="fedora" 2023-01-24T21:28:26.439 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="8.4" 2023-01-24T21:28:26.439 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el8" 2023-01-24T21:28:26.440 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-01-24T21:28:26.440 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2023-01-24T21:28:26.440 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-01-24T21:28:26.440 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://www.redhat.com/" 2023-01-24T21:28:26.441 INFO:teuthology.orchestra.run.smithi007.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-01-24T21:28:26.441 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-01-24T21:28:26.441 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:28:26.441 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-01-24T21:28:26.441 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-01-24T21:28:26.442 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-01-24T21:28:26.442 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-01-24T21:28:26.443 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2023-01-24T21:28:26.464 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-01-24T21:28:26.472 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-01-24T21:28:26.482 INFO:teuthology.task.internal:Checking for old test directory... 2023-01-24T21:28:26.483 DEBUG:teuthology.orchestra.run.smithi007:> test '!' -e /home/ubuntu/cephtest 2023-01-24T21:28:26.499 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-01-24T21:28:26.505 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-01-24T21:28:26.505 DEBUG:teuthology.orchestra.run.smithi007:> test -z $(ls -A /var/lib/ceph) 2023-01-24T21:28:26.557 INFO:teuthology.orchestra.run.smithi007.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-01-24T21:28:26.558 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-01-24T21:28:26.594 INFO:teuthology.run_tasks:Running task kernel... 2023-01-24T21:28:26.608 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-01-24T21:28:26.609 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-01-24T21:28:26.610 DEBUG:teuthology.orchestra.run.smithi007:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-24T21:28:26.626 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-24T21:28:26.627 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2023-01-24T21:28:26.684 INFO:teuthology.orchestra.run.smithi007.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-01-24T21:28:26.685 INFO:teuthology.task.kernel:Running kernel on smithi007: 4.18.0-305.25.1.el8_4.x86_64 2023-01-24T21:28:26.685 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum install -y kernel 2023-01-24T21:28:28.110 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:28:28.111 INFO:teuthology.orchestra.run.smithi007.stdout:Unable to read consumer identity 2023-01-24T21:28:29.464 INFO:teuthology.orchestra.run.smithi007.stdout:Copr repo for python3-asyncssh owned by ceph 35 kB/s | 3.5 kB 00:00 2023-01-24T21:28:31.290 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 7.4 MB/s | 13 MB 00:01 2023-01-24T21:28:34.197 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 4.6 MB/s | 24 kB 00:00 2023-01-24T21:28:34.901 INFO:teuthology.orchestra.run.smithi007.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-01-24T21:28:34.901 INFO:teuthology.orchestra.run.smithi007.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-01-24T21:28:34.901 INFO:teuthology.orchestra.run.smithi007.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-01-24T21:28:35.041 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-24T21:28:35.042 INFO:teuthology.orchestra.run.smithi007.stdout:Nothing to do. 2023-01-24T21:28:35.042 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-24T21:28:35.152 DEBUG:teuthology.orchestra.run.smithi007:> echo no | sudo yum reinstall kernel || true 2023-01-24T21:28:35.520 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:28:35.521 INFO:teuthology.orchestra.run.smithi007.stdout:Unable to read consumer identity 2023-01-24T21:28:35.815 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:00:01 ago on Tue 24 Jan 2023 09:28:34 PM UTC. 2023-01-24T21:28:35.953 INFO:teuthology.orchestra.run.smithi007.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-01-24T21:28:35.954 INFO:teuthology.orchestra.run.smithi007.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-01-24T21:28:35.954 INFO:teuthology.orchestra.run.smithi007.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-01-24T21:28:35.988 INFO:teuthology.orchestra.run.smithi007.stderr:Error: No packages marked for reinstall. 2023-01-24T21:28:36.039 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum reinstall -y kernel || true 2023-01-24T21:28:36.403 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:28:36.404 INFO:teuthology.orchestra.run.smithi007.stdout:Unable to read consumer identity 2023-01-24T21:28:36.696 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:00:02 ago on Tue 24 Jan 2023 09:28:34 PM UTC. 2023-01-24T21:28:36.819 INFO:teuthology.orchestra.run.smithi007.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-01-24T21:28:36.820 INFO:teuthology.orchestra.run.smithi007.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-01-24T21:28:36.820 INFO:teuthology.orchestra.run.smithi007.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-01-24T21:28:36.842 INFO:teuthology.orchestra.run.smithi007.stderr:Error: No packages marked for reinstall. 2023-01-24T21:28:36.893 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q kernel --last | head -n 1 2023-01-24T21:28:37.021 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-4.18.0-305.25.1.el8_4.x86_64 Wed 21 Dec 2022 01:05:24 PM UTC 2023-01-24T21:28:37.023 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.25.1.el8_4.x86_64 2023-01-24T21:28:37.023 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-01-24T21:28:37.023 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-01-24T21:28:37.023 DEBUG:teuthology.orchestra.run.smithi007:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-01-24T21:28:37.054 INFO:teuthology.orchestra.run.smithi007.stdout:ttyS1 2023-01-24T21:28:37.067 DEBUG:teuthology.parallel:result is None 2023-01-24T21:28:37.067 INFO:teuthology.run_tasks:Running task internal.base... 2023-01-24T21:28:37.074 INFO:teuthology.task.internal:Creating test directory... 2023-01-24T21:28:37.075 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-24T21:28:37.121 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-01-24T21:28:37.131 INFO:teuthology.run_tasks:Running task internal.archive... 2023-01-24T21:28:37.139 INFO:teuthology.task.internal:Creating archive directory... 2023-01-24T21:28:37.140 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-24T21:28:37.190 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-01-24T21:28:37.200 INFO:teuthology.task.internal:Enabling coredump saving... 2023-01-24T21:28:37.201 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-24T21:28:37.259 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-24T21:28:37.269 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-24T21:28:37.270 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-01-24T21:28:37.278 INFO:teuthology.task.internal:Configuring sudo... 2023-01-24T21:28:37.278 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-24T21:28:37.335 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-01-24T21:28:37.346 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-01-24T21:28:37.347 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-24T21:28:37.390 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-24T21:28:37.473 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-24T21:28:37.513 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-24T21:28:37.599 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-24T21:28:37.634 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-24T21:28:37.635 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-24T21:28:37.698 DEBUG:teuthology.orchestra.run.smithi007:> sudo service rsyslog restart 2023-01-24T21:28:37.836 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-01-24T21:28:38.044 INFO:teuthology.run_tasks:Running task internal.timer... 2023-01-24T21:28:38.052 INFO:teuthology.task.internal:Starting timer... 2023-01-24T21:28:38.053 INFO:teuthology.run_tasks:Running task pcp... 2023-01-24T21:28:38.064 INFO:teuthology.run_tasks:Running task selinux... 2023-01-24T21:28:38.073 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-01-24T21:28:38.073 DEBUG:teuthology.orchestra.run.smithi007:> sudo service auditd rotate 2023-01-24T21:28:38.130 INFO:teuthology.orchestra.run.smithi007.stdout:Rotating logs: [ OK ] 2023-01-24T21:28:38.131 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-01-24T21:28:38.132 DEBUG:teuthology.orchestra.run.smithi007:> /usr/sbin/getenforce 2023-01-24T21:28:38.149 INFO:teuthology.orchestra.run.smithi007.stdout:Permissive 2023-01-24T21:28:38.149 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi007.front.sepia.ceph.com': 'permissive'} 2023-01-24T21:28:38.149 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2023-01-24T21:28:38.214 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-24T21:28:38.215 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-01-24T21:28:38.216 DEBUG:teuthology.orchestra.run.smithi007:> sudo /usr/sbin/setenforce permissive 2023-01-24T21:28:38.280 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-01-24T21:28:38.293 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-01-24T21:28:38.294 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-01-24T21:28:38.310 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-01-24T21:28:38.312 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi007.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-01-24T21:35:17.370 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi007.front.sepia.ceph.com')] 2023-01-24T21:35:17.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-01-24T21:35:17.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-24T21:35:17.461 DEBUG:teuthology.orchestra.run.smithi007:> true 2023-01-24T21:35:17.529 INFO:teuthology.run_tasks:Running task clock... 2023-01-24T21:35:17.541 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-01-24T21:35:17.542 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-24T21:35:17.542 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-24T21:35:17.602 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-01-24T21:35:17.618 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-01-24T21:35:17.657 INFO:teuthology.orchestra.run.smithi007.stderr:sudo: ntpd: command not found 2023-01-24T21:35:17.668 INFO:teuthology.orchestra.run.smithi007.stdout:506 Cannot talk to daemon 2023-01-24T21:35:17.683 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-01-24T21:35:17.697 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-01-24T21:35:17.761 INFO:teuthology.orchestra.run.smithi007.stderr:bash: ntpq: command not found 2023-01-24T21:35:17.764 INFO:teuthology.orchestra.run.smithi007.stdout:210 Number of sources = 4 2023-01-24T21:35:17.764 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-01-24T21:35:17.765 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2023-01-24T21:35:17.765 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-24T21:35:17.765 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-24T21:35:17.765 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-24T21:35:17.765 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-24T21:35:17.766 INFO:teuthology.run_tasks:Running task install... 2023-01-24T21:35:17.779 DEBUG:teuthology.task.install:project ceph 2023-01-24T21:35:17.779 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '49f8fb05584886826e8eade75f7105fba754560c'}} 2023-01-24T21:35:17.780 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '49f8fb05584886826e8eade75f7105fba754560c'} 2023-01-24T21:35:17.780 INFO:teuthology.task.install:Using flavor: default 2023-01-24T21:35:17.788 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-01-24T21:35:17.789 INFO:teuthology.task.install:extra packages: [] 2023-01-24T21:35:17.790 DEBUG:teuthology.orchestra.run.smithi007:> sudo lsb_release -is 2023-01-24T21:35:17.844 INFO:teuthology.orchestra.run.smithi007.stdout:RedHatEnterprise 2023-01-24T21:35:17.845 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2023-01-24T21:35:17.846 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '49f8fb05584886826e8eade75f7105fba754560c', 'tag': None, 'wait_for_package': False} 2023-01-24T21:35:17.847 DEBUG:teuthology.orchestra.run.smithi007:> sudo lsb_release -is 2023-01-24T21:35:17.924 INFO:teuthology.orchestra.run.smithi007.stdout:RedHatEnterprise 2023-01-24T21:35:17.925 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2023-01-24T21:35:17.926 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=49f8fb05584886826e8eade75f7105fba754560c 2023-01-24T21:35:18.074 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/centos/8/flavors/default/ 2023-01-24T21:35:18.075 INFO:teuthology.task.install.rpm:Package version is 17.2.5-727.g49f8fb05 2023-01-24T21:35:18.193 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-01-24T21:35:18.194 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-24T21:35:18.194 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-01-24T21:35:18.219 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-01-24T21:35:18.219 DEBUG:teuthology.orchestra.run.smithi007:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/49f8fb05584886826e8eade75f7105fba754560c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-01-24T21:35:18.284 DEBUG:teuthology.orchestra.run.smithi007:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-01-24T21:35:18.360 DEBUG:teuthology.orchestra.run.smithi007:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-01-24T21:35:18.423 INFO:teuthology.orchestra.run.smithi007.stdout:check_obsoletes = 1 2023-01-24T21:35:18.424 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum clean all 2023-01-24T21:35:18.831 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:35:19.129 INFO:teuthology.orchestra.run.smithi007.stdout:44 files removed 2023-01-24T21:35:19.181 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-radosgw 2023-01-24T21:35:19.547 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:35:20.289 INFO:teuthology.orchestra.run.smithi007.stdout:ceph packages for x86_64 322 kB/s | 78 kB 00:00 2023-01-24T21:35:20.534 INFO:teuthology.orchestra.run.smithi007.stdout:ceph noarch packages 45 kB/s | 9.2 kB 00:00 2023-01-24T21:35:20.768 INFO:teuthology.orchestra.run.smithi007.stdout:ceph source packages 7.2 kB/s | 1.5 kB 00:00 2023-01-24T21:35:20.885 INFO:teuthology.orchestra.run.smithi007.stdout:Copr repo for python3-asyncssh owned by ceph 40 kB/s | 3.5 kB 00:00 2023-01-24T21:35:22.159 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 11 MB/s | 13 MB 00:01 2023-01-24T21:35:25.129 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 4.6 MB/s | 24 kB 00:00 2023-01-24T21:35:25.529 INFO:teuthology.orchestra.run.smithi007.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 103 MB/s | 33 MB 00:00 2023-01-24T21:35:30.989 INFO:teuthology.orchestra.run.smithi007.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 109 MB/s | 38 MB 00:00 2023-01-24T21:35:40.237 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-24T21:35:40.240 INFO:teuthology.orchestra.run.smithi007.stdout:=================================================================================================== 2023-01-24T21:35:40.240 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2023-01-24T21:35:40.241 INFO:teuthology.orchestra.run.smithi007.stdout:=================================================================================================== 2023-01-24T21:35:40.241 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-24T21:35:40.241 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 17 M 2023-01-24T21:35:40.241 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrading: 2023-01-24T21:35:40.242 INFO:teuthology.orchestra.run.smithi007.stdout: librados2 x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 3.5 M 2023-01-24T21:35:40.242 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1 x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 3.6 M 2023-01-24T21:35:40.242 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2023-01-24T21:35:40.242 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 5.1 M 2023-01-24T21:35:40.242 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 23 M 2023-01-24T21:35:40.243 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 24 k 2023-01-24T21:35:40.243 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-01-24T21:35:40.243 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2 x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 793 k 2023-01-24T21:35:40.243 INFO:teuthology.orchestra.run.smithi007.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-01-24T21:35:40.243 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-01-24T21:35:40.244 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1 x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 506 k 2023-01-24T21:35:40.244 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-01-24T21:35:40.244 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2 x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 5.5 M 2023-01-24T21:35:40.245 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-01-24T21:35:40.245 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-01-24T21:35:40.245 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 45 k 2023-01-24T21:35:40.248 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 108 k 2023-01-24T21:35:40.248 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 190 k 2023-01-24T21:35:40.248 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-01-24T21:35:40.248 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 370 k 2023-01-24T21:35:40.248 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 357 k 2023-01-24T21:35:40.249 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 107 k 2023-01-24T21:35:40.249 INFO:teuthology.orchestra.run.smithi007.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-01-24T21:35:40.249 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:35:40.249 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-24T21:35:40.249 INFO:teuthology.orchestra.run.smithi007.stdout:=================================================================================================== 2023-01-24T21:35:40.250 INFO:teuthology.orchestra.run.smithi007.stdout:Install 21 Packages 2023-01-24T21:35:40.250 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrade 2 Packages 2023-01-24T21:35:40.250 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:35:40.251 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 63 M 2023-01-24T21:35:40.251 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-24T21:35:40.999 INFO:teuthology.orchestra.run.smithi007.stdout:(1/23): ceph-base-17.2.5-727.g49f8fb05.el8.x86_ 6.8 MB/s | 5.1 MB 00:00 2023-01-24T21:35:41.044 INFO:teuthology.orchestra.run.smithi007.stdout:(2/23): ceph-selinux-17.2.5-727.g49f8fb05.el8.x 549 kB/s | 24 kB 00:00 2023-01-24T21:35:41.163 INFO:teuthology.orchestra.run.smithi007.stdout:(3/23): libcephfs2-17.2.5-727.g49f8fb05.el8.x86 6.5 MB/s | 793 kB 00:00 2023-01-24T21:35:41.235 INFO:teuthology.orchestra.run.smithi007.stdout:(4/23): libradosstriper1-17.2.5-727.g49f8fb05.e 6.9 MB/s | 506 kB 00:00 2023-01-24T21:35:41.941 INFO:teuthology.orchestra.run.smithi007.stdout:(5/23): librgw2-17.2.5-727.g49f8fb05.el8.x86_64 7.8 MB/s | 5.5 MB 00:00 2023-01-24T21:35:41.989 INFO:teuthology.orchestra.run.smithi007.stdout:(6/23): python3-ceph-argparse-17.2.5-727.g49f8f 941 kB/s | 45 kB 00:00 2023-01-24T21:35:42.122 INFO:teuthology.orchestra.run.smithi007.stdout:(7/23): ceph-radosgw-17.2.5-727.g49f8fb05.el8.x 8.9 MB/s | 17 MB 00:01 2023-01-24T21:35:42.124 INFO:teuthology.orchestra.run.smithi007.stdout:(8/23): python3-ceph-common-17.2.5-727.g49f8fb0 801 kB/s | 108 kB 00:00 2023-01-24T21:35:42.165 INFO:teuthology.orchestra.run.smithi007.stdout:(9/23): python3-cephfs-17.2.5-727.g49f8fb05.el8 4.4 MB/s | 190 kB 00:00 2023-01-24T21:35:42.178 INFO:teuthology.orchestra.run.smithi007.stdout:(10/23): python3-rados-17.2.5-727.g49f8fb05.el8 6.8 MB/s | 370 kB 00:00 2023-01-24T21:35:42.214 INFO:teuthology.orchestra.run.smithi007.stdout:(11/23): python3-rbd-17.2.5-727.g49f8fb05.el8.x 7.2 MB/s | 357 kB 00:00 2023-01-24T21:35:42.218 INFO:teuthology.orchestra.run.smithi007.stdout:(12/23): python3-rgw-17.2.5-727.g49f8fb05.el8.x 2.6 MB/s | 107 kB 00:00 2023-01-24T21:35:42.444 INFO:teuthology.orchestra.run.smithi007.stdout:(13/23): ceph-common-17.2.5-727.g49f8fb05.el8.x 11 MB/s | 23 MB 00:02 2023-01-24T21:35:42.511 INFO:teuthology.orchestra.run.smithi007.stdout:(14/23): liboath-2.6.2-3.el8.x86_64.rpm 201 kB/s | 59 kB 00:00 2023-01-24T21:35:42.540 INFO:teuthology.orchestra.run.smithi007.stdout:(15/23): gperftools-libs-2.7-9.el8.x86_64.rpm 942 kB/s | 306 kB 00:00 2023-01-24T21:35:42.573 INFO:teuthology.orchestra.run.smithi007.stdout:(16/23): python3-prettytable-0.7.2-14.el8.noarc 1.3 MB/s | 44 kB 00:00 2023-01-24T21:35:42.590 INFO:teuthology.orchestra.run.smithi007.stdout:(17/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 15 MB/s | 259 kB 00:00 2023-01-24T21:35:42.594 INFO:teuthology.orchestra.run.smithi007.stdout:(18/23): libunwind-1.3.1-3.el8.x86_64.rpm 502 kB/s | 75 kB 00:00 2023-01-24T21:35:42.620 INFO:teuthology.orchestra.run.smithi007.stdout:(19/23): librdkafka-0.11.4-1.el8.x86_64.rpm 12 MB/s | 353 kB 00:00 2023-01-24T21:35:42.629 INFO:teuthology.orchestra.run.smithi007.stdout:(20/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.3 MB/s | 47 kB 00:00 2023-01-24T21:35:42.766 INFO:teuthology.orchestra.run.smithi007.stdout:(21/23): thrift-0.13.0-2.el8.x86_64.rpm 6.8 MB/s | 1.7 MB 00:00 2023-01-24T21:35:42.866 INFO:teuthology.orchestra.run.smithi007.stdout:(22/23): librbd1-17.2.5-727.g49f8fb05.el8.x86_6 15 MB/s | 3.6 MB 00:00 2023-01-24T21:35:42.900 INFO:teuthology.orchestra.run.smithi007.stdout:(23/23): librados2-17.2.5-727.g49f8fb05.el8.x86 12 MB/s | 3.5 MB 00:00 2023-01-24T21:35:42.903 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-24T21:35:42.903 INFO:teuthology.orchestra.run.smithi007.stdout:Total 24 MB/s | 63 MB 00:02 2023-01-24T21:35:42.908 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-24T21:35:42.957 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-24T21:35:42.957 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-24T21:35:43.742 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-24T21:35:43.747 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-24T21:35:44.835 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-24T21:35:45.036 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 1/25 2023-01-24T21:35:45.442 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 1/25 2023-01-24T21:35:45.653 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librados2-2:17.2.5-727.g49f8fb05.el8.x86_64 2/25 2023-01-24T21:35:45.758 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-2:17.2.5-727.g49f8fb05.el8.x86_64 2/25 2023-01-24T21:35:45.926 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rados-2:17.2.5-727.g49f8fb05.el8.x86_64 3/25 2023-01-24T21:35:46.225 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/25 2023-01-24T21:35:46.411 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs2-2:17.2.5-727.g49f8fb05.el8.x86_64 5/25 2023-01-24T21:35:46.823 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephfs2-2:17.2.5-727.g49f8fb05.el8.x86_64 5/25 2023-01-24T21:35:47.079 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librbd1-2:17.2.5-727.g49f8fb05.el8.x86_64 6/25 2023-01-24T21:35:47.147 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-2:17.2.5-727.g49f8fb05.el8.x86_64 6/25 2023-01-24T21:35:47.368 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/25 2023-01-24T21:35:47.545 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/25 2023-01-24T21:35:47.759 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/25 2023-01-24T21:35:48.594 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/25 2023-01-24T21:35:48.752 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librgw2-2:17.2.5-727.g49f8fb05.el8.x86_64 10/25 2023-01-24T21:35:48.811 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librgw2-2:17.2.5-727.g49f8fb05.el8.x86_64 10/25 2023-01-24T21:35:48.939 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-argparse-2:17.2.5-727.g49f8fb05.el8.x 11/25 2023-01-24T21:35:49.107 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cephfs-2:17.2.5-727.g49f8fb05.el8.x86_64 12/25 2023-01-24T21:35:49.324 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rgw-2:17.2.5-727.g49f8fb05.el8.x86_64 13/25 2023-01-24T21:35:49.526 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rbd-2:17.2.5-727.g49f8fb05.el8.x86_64 14/25 2023-01-24T21:35:49.669 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libradosstriper1-2:17.2.5-727.g49f8fb05.el8.x86_64 15/25 2023-01-24T21:35:49.742 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libradosstriper1-2:17.2.5-727.g49f8fb05.el8.x86_64 15/25 2023-01-24T21:35:49.930 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-01-24T21:35:50.132 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/25 2023-01-24T21:35:50.370 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-01-24T21:35:50.537 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-common-2:17.2.5-727.g49f8fb05.el8.x86 19/25 2023-01-24T21:35:55.612 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:17.2.5-727.g49f8fb05.el8.x86_64 20/25 2023-01-24T21:35:55.811 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-common-2:17.2.5-727.g49f8fb05.el8.x86_64 20/25 2023-01-24T21:35:56.426 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:17.2.5-727.g49f8fb05.el8.x86_64 20/25 2023-01-24T21:35:56.708 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-base-2:17.2.5-727.g49f8fb05.el8.x86_64 21/25 2023-01-24T21:35:56.792 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-base-2:17.2.5-727.g49f8fb05.el8.x86_64 21/25 2023-01-24T21:35:56.901 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-selinux-2:17.2.5-727.g49f8fb05.el8.x86_64 22/25 2023-01-24T21:36:15.198 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-selinux-2:17.2.5-727.g49f8fb05.el8.x86_64 22/25 2023-01-24T21:36:15.198 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /sys 2023-01-24T21:36:15.199 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /proc 2023-01-24T21:36:15.199 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /dev 2023-01-24T21:36:15.199 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /run 2023-01-24T21:36:15.199 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /mnt 2023-01-24T21:36:15.199 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /var/tmp 2023-01-24T21:36:15.200 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /home 2023-01-24T21:36:15.200 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /tmp 2023-01-24T21:36:15.200 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /dev 2023-01-24T21:36:15.200 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:36:17.013 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-radosgw-2:17.2.5-727.g49f8fb05.el8.x86_64 23/25 2023-01-24T21:36:17.090 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-radosgw-2:17.2.5-727.g49f8fb05.el8.x86_64 23/25 2023-01-24T21:36:17.090 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-24T21:36:17.275 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-24T21:36:17.276 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-24T21:36:17.799 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-24T21:36:17.799 INFO:teuthology.orchestra.run.smithi007.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-01-24T21:36:17.800 INFO:teuthology.orchestra.run.smithi007.stdout:All rules containing unresolvable specifiers will be skipped. 2023-01-24T21:36:17.800 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:36:18.070 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-base-2:17.2.5-727.g49f8fb05.el8.x86_64 1/25 2023-01-24T21:36:18.070 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-common-2:17.2.5-727.g49f8fb05.el8.x86_64 2/25 2023-01-24T21:36:18.070 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-radosgw-2:17.2.5-727.g49f8fb05.el8.x86_64 3/25 2023-01-24T21:36:18.070 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-selinux-2:17.2.5-727.g49f8fb05.el8.x86_64 4/25 2023-01-24T21:36:18.071 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs2-2:17.2.5-727.g49f8fb05.el8.x86_64 5/25 2023-01-24T21:36:18.071 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libradosstriper1-2:17.2.5-727.g49f8fb05.el8.x86_64 6/25 2023-01-24T21:36:18.071 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librgw2-2:17.2.5-727.g49f8fb05.el8.x86_64 7/25 2023-01-24T21:36:18.071 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-argparse-2:17.2.5-727.g49f8fb05.el8.x 8/25 2023-01-24T21:36:18.071 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-common-2:17.2.5-727.g49f8fb05.el8.x86 9/25 2023-01-24T21:36:18.072 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cephfs-2:17.2.5-727.g49f8fb05.el8.x86_64 10/25 2023-01-24T21:36:18.072 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rados-2:17.2.5-727.g49f8fb05.el8.x86_64 11/25 2023-01-24T21:36:18.072 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rbd-2:17.2.5-727.g49f8fb05.el8.x86_64 12/25 2023-01-24T21:36:18.072 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rgw-2:17.2.5-727.g49f8fb05.el8.x86_64 13/25 2023-01-24T21:36:18.073 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 14/25 2023-01-24T21:36:18.073 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 15/25 2023-01-24T21:36:18.073 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 16/25 2023-01-24T21:36:18.073 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 17/25 2023-01-24T21:36:18.073 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-01-24T21:36:18.073 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 19/25 2023-01-24T21:36:18.074 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 20/25 2023-01-24T21:36:18.074 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 21/25 2023-01-24T21:36:18.074 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-2:17.2.5-727.g49f8fb05.el8.x86_64 22/25 2023-01-24T21:36:18.074 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-01-24T21:36:18.074 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-2:17.2.5-727.g49f8fb05.el8.x86_64 24/25 2023-01-24T21:36:19.551 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-01-24T21:36:19.551 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:00:49 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:36:21.557 INFO:teuthology.orchestra.run.smithi007.stdout:Installed products updated. 2023-01-24T21:36:21.677 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:36:21.677 INFO:teuthology.orchestra.run.smithi007.stdout:Upgraded: 2023-01-24T21:36:21.677 INFO:teuthology.orchestra.run.smithi007.stdout: librados2-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:36:21.678 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:36:21.678 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-24T21:36:21.678 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:36:21.679 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:36:21.679 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:36:21.679 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:36:21.679 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-01-24T21:36:21.680 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:36:21.680 INFO:teuthology.orchestra.run.smithi007.stdout: liboath-2.6.2-3.el8.x86_64 2023-01-24T21:36:21.680 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-01-24T21:36:21.680 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:36:21.680 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-01-24T21:36:21.681 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:36:21.681 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind-1.3.1-3.el8.x86_64 2023-01-24T21:36:21.681 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-01-24T21:36:21.682 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:36:21.682 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:36:21.682 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:36:21.683 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-01-24T21:36:21.683 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:36:21.683 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:36:21.683 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:36:21.684 INFO:teuthology.orchestra.run.smithi007.stdout: thrift-0.13.0-2.el8.x86_64 2023-01-24T21:36:21.684 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:36:21.684 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-24T21:36:21.829 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-test 2023-01-24T21:36:22.211 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:36:23.121 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:00:53 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:36:25.003 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-24T21:36:25.004 INFO:teuthology.orchestra.run.smithi007.stdout:=========================================================================================== 2023-01-24T21:36:25.004 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2023-01-24T21:36:25.004 INFO:teuthology.orchestra.run.smithi007.stdout:=========================================================================================== 2023-01-24T21:36:25.005 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-24T21:36:25.005 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 52 M 2023-01-24T21:36:25.005 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2023-01-24T21:36:25.005 INFO:teuthology.orchestra.run.smithi007.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-01-24T21:36:25.005 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 174 k 2023-01-24T21:36:25.006 INFO:teuthology.orchestra.run.smithi007.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-01-24T21:36:25.006 INFO:teuthology.orchestra.run.smithi007.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-01-24T21:36:25.006 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-01-24T21:36:25.006 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:36:25.006 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-24T21:36:25.007 INFO:teuthology.orchestra.run.smithi007.stdout:=========================================================================================== 2023-01-24T21:36:25.007 INFO:teuthology.orchestra.run.smithi007.stdout:Install 6 Packages 2023-01-24T21:36:25.007 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:36:25.008 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 53 M 2023-01-24T21:36:25.008 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 233 M 2023-01-24T21:36:25.008 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-24T21:36:25.010 INFO:teuthology.orchestra.run.smithi007.stdout:(1/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 20 MB/s | 70 kB 00:00 2023-01-24T21:36:25.042 INFO:teuthology.orchestra.run.smithi007.stdout:(2/6): jq-1.5-12.el8.x86_64.rpm 5.0 MB/s | 161 kB 00:00 2023-01-24T21:36:25.056 INFO:teuthology.orchestra.run.smithi007.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 12 MB/s | 187 kB 00:00 2023-01-24T21:36:25.072 INFO:teuthology.orchestra.run.smithi007.stdout:(4/6): socat-1.7.3.3-2.el8.x86_64.rpm 19 MB/s | 302 kB 00:00 2023-01-24T21:36:25.178 INFO:teuthology.orchestra.run.smithi007.stdout:(5/6): libcephsqlite-17.2.5-727.g49f8fb05.el8.x 1.0 MB/s | 174 kB 00:00 2023-01-24T21:36:27.442 INFO:teuthology.orchestra.run.smithi007.stdout:(6/6): ceph-test-17.2.5-727.g49f8fb05.el8.x86_6 21 MB/s | 52 MB 00:02 2023-01-24T21:36:27.446 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-24T21:36:27.446 INFO:teuthology.orchestra.run.smithi007.stdout:Total 22 MB/s | 53 MB 00:02 2023-01-24T21:36:27.450 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-24T21:36:27.477 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-24T21:36:27.477 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-24T21:36:27.832 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-24T21:36:27.836 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-24T21:36:28.357 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-24T21:36:28.557 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 1/6 2023-01-24T21:36:28.746 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 2/6 2023-01-24T21:36:28.832 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 2/6 2023-01-24T21:36:28.996 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : jq-1.5-12.el8.x86_64 3/6 2023-01-24T21:36:29.154 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 4/6 2023-01-24T21:36:29.279 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephsqlite-2:17.2.5-727.g49f8fb05.el8.x86_64 5/6 2023-01-24T21:36:34.609 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephsqlite-2:17.2.5-727.g49f8fb05.el8.x86_64 5/6 2023-01-24T21:36:34.844 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-test-2:17.2.5-727.g49f8fb05.el8.x86_64 6/6 2023-01-24T21:36:35.131 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-test-2:17.2.5-727.g49f8fb05.el8.x86_64 6/6 2023-01-24T21:36:35.132 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-test-2:17.2.5-727.g49f8fb05.el8.x86_64 1/6 2023-01-24T21:36:35.132 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephsqlite-2:17.2.5-727.g49f8fb05.el8.x86_64 2/6 2023-01-24T21:36:35.132 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 3/6 2023-01-24T21:36:35.132 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : jq-1.5-12.el8.x86_64 4/6 2023-01-24T21:36:35.133 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 5/6 2023-01-24T21:36:36.260 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 6/6 2023-01-24T21:36:36.261 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:01:06 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:36:38.227 INFO:teuthology.orchestra.run.smithi007.stdout:Installed products updated. 2023-01-24T21:36:38.336 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:36:38.337 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-24T21:36:38.337 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:36:38.337 INFO:teuthology.orchestra.run.smithi007.stdout: jq-1.5-12.el8.x86_64 2023-01-24T21:36:38.337 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:36:38.338 INFO:teuthology.orchestra.run.smithi007.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-01-24T21:36:38.338 INFO:teuthology.orchestra.run.smithi007.stdout: socat-1.7.3.3-2.el8.x86_64 2023-01-24T21:36:38.338 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-01-24T21:36:38.338 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:36:38.338 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-24T21:36:38.452 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph 2023-01-24T21:36:38.821 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:36:39.683 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:01:09 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:36:41.557 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-24T21:36:41.560 INFO:teuthology.orchestra.run.smithi007.stdout:====================================================================================================== 2023-01-24T21:36:41.560 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2023-01-24T21:36:41.560 INFO:teuthology.orchestra.run.smithi007.stdout:====================================================================================================== 2023-01-24T21:36:41.560 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-24T21:36:41.561 INFO:teuthology.orchestra.run.smithi007.stdout: ceph x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 6.4 k 2023-01-24T21:36:41.561 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2023-01-24T21:36:41.561 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 2.3 M 2023-01-24T21:36:41.561 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 1.6 M 2023-01-24T21:36:41.561 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core noarch 2:17.2.5-727.g49f8fb05.el8 ceph-noarch 233 k 2023-01-24T21:36:41.562 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 3.9 M 2023-01-24T21:36:41.562 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 17 M 2023-01-24T21:36:41.562 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-01-24T21:36:41.562 INFO:teuthology.orchestra.run.smithi007.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-01-24T21:36:41.563 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-01-24T21:36:41.563 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-01-24T21:36:41.563 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-01-24T21:36:41.563 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-01-24T21:36:41.563 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-01-24T21:36:41.564 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-01-24T21:36:41.564 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-01-24T21:36:41.564 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-01-24T21:36:41.564 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-01-24T21:36:41.564 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-01-24T21:36:41.565 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-01-24T21:36:41.565 INFO:teuthology.orchestra.run.smithi007.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-01-24T21:36:41.565 INFO:teuthology.orchestra.run.smithi007.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-01-24T21:36:41.565 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-01-24T21:36:41.565 INFO:teuthology.orchestra.run.smithi007.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-01-24T21:36:41.565 INFO:teuthology.orchestra.run.smithi007.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-01-24T21:36:41.566 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-01-24T21:36:41.566 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-01-24T21:36:41.566 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-01-24T21:36:41.566 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-01-24T21:36:41.566 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:36:41.567 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-24T21:36:41.567 INFO:teuthology.orchestra.run.smithi007.stdout:====================================================================================================== 2023-01-24T21:36:41.567 INFO:teuthology.orchestra.run.smithi007.stdout:Install 28 Packages 2023-01-24T21:36:41.568 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:36:41.568 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 27 M 2023-01-24T21:36:41.569 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 105 M 2023-01-24T21:36:41.569 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-24T21:36:41.663 INFO:teuthology.orchestra.run.smithi007.stdout:(1/28): ceph-17.2.5-727.g49f8fb05.el8.x86_64.rp 66 kB/s | 6.4 kB 00:00 2023-01-24T21:36:41.944 INFO:teuthology.orchestra.run.smithi007.stdout:(2/28): ceph-mgr-17.2.5-727.g49f8fb05.el8.x86_6 4.1 MB/s | 1.6 MB 00:00 2023-01-24T21:36:42.008 INFO:teuthology.orchestra.run.smithi007.stdout:(3/28): ceph-mds-17.2.5-727.g49f8fb05.el8.x86_6 5.2 MB/s | 2.3 MB 00:00 2023-01-24T21:36:42.033 INFO:teuthology.orchestra.run.smithi007.stdout:(4/28): ceph-mgr-modules-core-17.2.5-727.g49f8f 9.0 MB/s | 233 kB 00:00 2023-01-24T21:36:42.144 INFO:teuthology.orchestra.run.smithi007.stdout:(5/28): python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm 395 kB/s | 44 kB 00:00 2023-01-24T21:36:42.166 INFO:teuthology.orchestra.run.smithi007.stdout:(6/28): ceph-mon-17.2.5-727.g49f8fb05.el8.x86_6 7.8 MB/s | 3.9 MB 00:00 2023-01-24T21:36:42.226 INFO:teuthology.orchestra.run.smithi007.stdout:(7/28): python3-beautifulsoup4-4.6.3-2.el8.1.no 2.2 MB/s | 185 kB 00:00 2023-01-24T21:36:42.305 INFO:teuthology.orchestra.run.smithi007.stdout:(8/28): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.2 MB/s | 173 kB 00:00 2023-01-24T21:36:42.333 INFO:teuthology.orchestra.run.smithi007.stdout:(9/28): python3-jaraco-6.2-6.el8.noarch.rpm 398 kB/s | 11 kB 00:00 2023-01-24T21:36:42.336 INFO:teuthology.orchestra.run.smithi007.stdout:(10/28): python3-cherrypy-18.4.0-1.el8.noarch.r 3.4 MB/s | 384 kB 00:00 2023-01-24T21:36:42.361 INFO:teuthology.orchestra.run.smithi007.stdout:(11/28): python3-jaraco-functools-2.0-4.el8.noa 640 kB/s | 18 kB 00:00 2023-01-24T21:36:42.365 INFO:teuthology.orchestra.run.smithi007.stdout:(12/28): python3-logutils-0.3.5-11.el8.noarch.r 1.7 MB/s | 49 kB 00:00 2023-01-24T21:36:42.388 INFO:teuthology.orchestra.run.smithi007.stdout:(13/28): python3-more-itertools-7.2.0-3.el8.noa 2.1 MB/s | 59 kB 00:00 2023-01-24T21:36:42.416 INFO:teuthology.orchestra.run.smithi007.stdout:(14/28): python3-portend-2.6-1.el8.noarch.rpm 566 kB/s | 16 kB 00:00 2023-01-24T21:36:42.444 INFO:teuthology.orchestra.run.smithi007.stdout:(15/28): python3-simplegeneric-0.8.1-17.el8.noa 666 kB/s | 19 kB 00:00 2023-01-24T21:36:42.447 INFO:teuthology.orchestra.run.smithi007.stdout:(16/28): python3-pecan-1.3.2-9.el8.noarch.rpm 3.3 MB/s | 283 kB 00:00 2023-01-24T21:36:42.472 INFO:teuthology.orchestra.run.smithi007.stdout:(17/28): python3-singledispatch-3.4.0.3-18.el8. 871 kB/s | 24 kB 00:00 2023-01-24T21:36:42.475 INFO:teuthology.orchestra.run.smithi007.stdout:(18/28): python3-tempora-1.14.1-5.el8.noarch.rp 1.0 MB/s | 29 kB 00:00 2023-01-24T21:36:42.500 INFO:teuthology.orchestra.run.smithi007.stdout:(19/28): python3-trustme-0.6.0-4.el8.noarch.rpm 995 kB/s | 27 kB 00:00 2023-01-24T21:36:42.532 INFO:teuthology.orchestra.run.smithi007.stdout:(20/28): python3-waitress-1.2.1-2.el8.1.noarch. 4.2 MB/s | 241 kB 00:00 2023-01-24T21:36:42.561 INFO:teuthology.orchestra.run.smithi007.stdout:(21/28): python3-webtest-2.0.33-1.el8.noarch.rp 2.9 MB/s | 85 kB 00:00 2023-01-24T21:36:42.584 INFO:teuthology.orchestra.run.smithi007.stdout:(22/28): python3-webob-1.8.5-1.el8.1.noarch.rpm 3.0 MB/s | 251 kB 00:00 2023-01-24T21:36:42.589 INFO:teuthology.orchestra.run.smithi007.stdout:(23/28): python3-zc-lockfile-2.0-2.el8.noarch.r 825 kB/s | 23 kB 00:00 2023-01-24T21:36:42.618 INFO:teuthology.orchestra.run.smithi007.stdout:(24/28): python3-werkzeug-0.12.2-4.el8.noarch.r 13 MB/s | 457 kB 00:00 2023-01-24T21:36:42.628 INFO:teuthology.orchestra.run.smithi007.stdout:(25/28): python3-markupsafe-0.23-19.el8.x86_64. 1.0 MB/s | 39 kB 00:00 2023-01-24T21:36:42.638 INFO:teuthology.orchestra.run.smithi007.stdout:(26/28): python3-mako-1.0.6-13.el8.noarch.rpm 7.8 MB/s | 157 kB 00:00 2023-01-24T21:36:42.642 INFO:teuthology.orchestra.run.smithi007.stdout:(27/28): python3-pytz-2017.2-9.el8.noarch.rpm 3.8 MB/s | 54 kB 00:00 2023-01-24T21:36:42.867 INFO:teuthology.orchestra.run.smithi007.stdout:(28/28): ceph-osd-17.2.5-727.g49f8fb05.el8.x86_ 18 MB/s | 17 MB 00:00 2023-01-24T21:36:42.870 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-24T21:36:42.870 INFO:teuthology.orchestra.run.smithi007.stdout:Total 21 MB/s | 27 MB 00:01 2023-01-24T21:36:42.875 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-24T21:36:42.914 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-24T21:36:42.914 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-24T21:36:43.271 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-24T21:36:43.276 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-24T21:36:44.279 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-24T21:36:44.474 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/28 2023-01-24T21:36:44.768 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/28 2023-01-24T21:36:44.949 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 3/28 2023-01-24T21:36:45.199 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 4/28 2023-01-24T21:36:45.574 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 5/28 2023-01-24T21:36:45.787 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 6/28 2023-01-24T21:36:46.003 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 7/28 2023-01-24T21:36:46.195 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 8/28 2023-01-24T21:36:46.335 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 9/28 2023-01-24T21:36:46.457 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 10/28 2023-01-24T21:36:46.635 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 11/28 2023-01-24T21:36:46.847 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 12/28 2023-01-24T21:36:46.993 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 13/28 2023-01-24T21:36:47.202 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 14/28 2023-01-24T21:36:47.527 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 15/28 2023-01-24T21:36:47.709 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 16/28 2023-01-24T21:36:47.959 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-portend-2.6-1.el8.noarch 17/28 2023-01-24T21:36:48.205 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 18/28 2023-01-24T21:36:48.415 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 19/28 2023-01-24T21:36:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 20/28 2023-01-24T21:36:48.962 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 21/28 2023-01-24T21:36:49.235 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 22/28 2023-01-24T21:36:49.624 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-modules-core-2:17.2.5-727.g49f8fb05.el8.n 23/28 2023-01-24T21:36:50.441 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-2:17.2.5-727.g49f8fb05.el8.x86_64 24/28 2023-01-24T21:36:52.014 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-2:17.2.5-727.g49f8fb05.el8.x86_64 24/28 2023-01-24T21:36:52.182 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-osd-2:17.2.5-727.g49f8fb05.el8.x86_64 25/28 2023-01-24T21:36:52.598 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-osd-2:17.2.5-727.g49f8fb05.el8.x86_64 25/28 2023-01-24T21:36:52.801 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mon-2:17.2.5-727.g49f8fb05.el8.x86_64 26/28 2023-01-24T21:36:53.030 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mon-2:17.2.5-727.g49f8fb05.el8.x86_64 26/28 2023-01-24T21:36:53.200 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mds-2:17.2.5-727.g49f8fb05.el8.x86_64 27/28 2023-01-24T21:36:53.219 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mds-2:17.2.5-727.g49f8fb05.el8.x86_64 27/28 2023-01-24T21:36:53.334 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-2:17.2.5-727.g49f8fb05.el8.x86_64 28/28 2023-01-24T21:36:53.738 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-2:17.2.5-727.g49f8fb05.el8.x86_64 28/28 2023-01-24T21:36:53.738 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-2:17.2.5-727.g49f8fb05.el8.x86_64 1/28 2023-01-24T21:36:53.738 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mds-2:17.2.5-727.g49f8fb05.el8.x86_64 2/28 2023-01-24T21:36:53.739 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-2:17.2.5-727.g49f8fb05.el8.x86_64 3/28 2023-01-24T21:36:53.739 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mon-2:17.2.5-727.g49f8fb05.el8.x86_64 4/28 2023-01-24T21:36:53.739 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-osd-2:17.2.5-727.g49f8fb05.el8.x86_64 5/28 2023-01-24T21:36:53.739 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-modules-core-2:17.2.5-727.g49f8fb05.el8.n 6/28 2023-01-24T21:36:53.739 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 7/28 2023-01-24T21:36:53.740 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 8/28 2023-01-24T21:36:53.740 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 9/28 2023-01-24T21:36:53.740 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 10/28 2023-01-24T21:36:53.740 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 11/28 2023-01-24T21:36:53.741 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 12/28 2023-01-24T21:36:53.741 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 13/28 2023-01-24T21:36:53.741 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 14/28 2023-01-24T21:36:53.741 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 15/28 2023-01-24T21:36:53.741 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-portend-2.6-1.el8.noarch 16/28 2023-01-24T21:36:53.742 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 17/28 2023-01-24T21:36:53.742 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 18/28 2023-01-24T21:36:53.742 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 19/28 2023-01-24T21:36:53.742 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 20/28 2023-01-24T21:36:53.742 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 21/28 2023-01-24T21:36:53.743 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 22/28 2023-01-24T21:36:53.743 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 23/28 2023-01-24T21:36:53.743 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 24/28 2023-01-24T21:36:53.743 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 25/28 2023-01-24T21:36:53.743 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 26/28 2023-01-24T21:36:53.744 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 27/28 2023-01-24T21:36:55.211 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 28/28 2023-01-24T21:36:55.212 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:01:25 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:36:57.149 INFO:teuthology.orchestra.run.smithi007.stdout:Installed products updated. 2023-01-24T21:36:57.259 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:36:57.259 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-24T21:36:57.259 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:36:57.259 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:36:57.260 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:36:57.260 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core-2:17.2.5-727.g49f8fb05.el8.noarch 2023-01-24T21:36:57.260 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:36:57.261 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:36:57.261 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-01-24T21:36:57.261 INFO:teuthology.orchestra.run.smithi007.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-01-24T21:36:57.261 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-01-24T21:36:57.262 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-01-24T21:36:57.262 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-6.2-6.el8.noarch 2023-01-24T21:36:57.262 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-01-24T21:36:57.262 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-01-24T21:36:57.262 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako-1.0.6-13.el8.noarch 2023-01-24T21:36:57.263 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-01-24T21:36:57.263 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-01-24T21:36:57.263 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-01-24T21:36:57.263 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend-2.6-1.el8.noarch 2023-01-24T21:36:57.263 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz-2017.2-9.el8.noarch 2023-01-24T21:36:57.264 INFO:teuthology.orchestra.run.smithi007.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-01-24T21:36:57.264 INFO:teuthology.orchestra.run.smithi007.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-01-24T21:36:57.264 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-01-24T21:36:57.264 INFO:teuthology.orchestra.run.smithi007.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-01-24T21:36:57.264 INFO:teuthology.orchestra.run.smithi007.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-01-24T21:36:57.265 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-01-24T21:36:57.265 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-01-24T21:36:57.265 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-01-24T21:36:57.265 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-01-24T21:36:57.266 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:36:57.266 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-24T21:36:57.401 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-base 2023-01-24T21:36:57.783 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:36:58.690 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:01:28 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:37:00.096 INFO:teuthology.orchestra.run.smithi007.stdout:Package ceph-base-2:17.2.5-727.g49f8fb05.el8.x86_64 is already installed. 2023-01-24T21:37:00.582 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-24T21:37:00.583 INFO:teuthology.orchestra.run.smithi007.stdout:Nothing to do. 2023-01-24T21:37:00.583 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-24T21:37:00.681 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install cephadm 2023-01-24T21:37:01.061 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:37:02.034 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:01:32 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:37:03.922 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-24T21:37:03.923 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-24T21:37:03.923 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2023-01-24T21:37:03.923 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-24T21:37:03.923 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-24T21:37:03.924 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm noarch 2:17.2.5-727.g49f8fb05.el8 ceph-noarch 78 k 2023-01-24T21:37:03.924 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:37:03.924 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-24T21:37:03.924 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-24T21:37:03.924 INFO:teuthology.orchestra.run.smithi007.stdout:Install 1 Package 2023-01-24T21:37:03.925 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:37:03.925 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 78 k 2023-01-24T21:37:03.925 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 355 k 2023-01-24T21:37:03.925 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-24T21:37:04.068 INFO:teuthology.orchestra.run.smithi007.stdout:cephadm-17.2.5-727.g49f8fb05.el8.noarch.rpm 542 kB/s | 78 kB 00:00 2023-01-24T21:37:04.069 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-24T21:37:04.069 INFO:teuthology.orchestra.run.smithi007.stdout:Total 537 kB/s | 78 kB 00:00 2023-01-24T21:37:04.069 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-24T21:37:04.078 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-24T21:37:04.078 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-24T21:37:04.080 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-24T21:37:04.085 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-24T21:37:04.135 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-24T21:37:06.787 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephadm-2:17.2.5-727.g49f8fb05.el8.noarch 1/1 2023-01-24T21:37:06.926 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephadm-2:17.2.5-727.g49f8fb05.el8.noarch 1/1 2023-01-24T21:37:07.135 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephadm-2:17.2.5-727.g49f8fb05.el8.noarch 1/1 2023-01-24T21:37:08.984 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephadm-2:17.2.5-727.g49f8fb05.el8.noarch 1/1 2023-01-24T21:37:08.984 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:01:38 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:37:10.882 INFO:teuthology.orchestra.run.smithi007.stdout:Installed products updated. 2023-01-24T21:37:10.987 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:37:10.987 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-24T21:37:10.987 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm-2:17.2.5-727.g49f8fb05.el8.noarch 2023-01-24T21:37:10.988 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:37:10.988 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-24T21:37:11.117 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-immutable-object-cache 2023-01-24T21:37:11.508 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:37:12.406 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:01:42 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:37:14.255 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-24T21:37:14.256 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-24T21:37:14.256 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repo Size 2023-01-24T21:37:14.257 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-24T21:37:14.257 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-24T21:37:14.257 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 162 k 2023-01-24T21:37:14.257 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:37:14.257 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-24T21:37:14.258 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-24T21:37:14.258 INFO:teuthology.orchestra.run.smithi007.stdout:Install 1 Package 2023-01-24T21:37:14.258 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:37:14.258 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 162 k 2023-01-24T21:37:14.258 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 490 k 2023-01-24T21:37:14.259 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-24T21:37:14.423 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-immutable-object-cache-17.2.5-727.g49f8fb0 973 kB/s | 162 kB 00:00 2023-01-24T21:37:14.424 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-24T21:37:14.424 INFO:teuthology.orchestra.run.smithi007.stdout:Total 964 kB/s | 162 kB 00:00 2023-01-24T21:37:14.425 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-24T21:37:14.439 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-24T21:37:14.439 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-24T21:37:14.495 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-24T21:37:14.501 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-24T21:37:14.625 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-24T21:37:14.797 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-immutable-object-cache-2:17.2.5-727.g49f8fb05.e 1/1 2023-01-24T21:37:15.216 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.5-727.g49f8fb05.e 1/1 2023-01-24T21:37:16.269 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-immutable-object-cache-2:17.2.5-727.g49f8fb05.e 1/1 2023-01-24T21:37:16.270 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:01:46 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:37:18.627 INFO:teuthology.orchestra.run.smithi007.stdout:Installed products updated. 2023-01-24T21:37:18.731 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:37:18.731 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-24T21:37:18.732 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:37:18.732 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:37:18.732 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-24T21:37:18.848 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-mgr 2023-01-24T21:37:19.231 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:37:20.155 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:01:50 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:37:21.541 INFO:teuthology.orchestra.run.smithi007.stdout:Package ceph-mgr-2:17.2.5-727.g49f8fb05.el8.x86_64 is already installed. 2023-01-24T21:37:22.021 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-24T21:37:22.022 INFO:teuthology.orchestra.run.smithi007.stdout:Nothing to do. 2023-01-24T21:37:22.022 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-24T21:37:22.123 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-mgr-dashboard 2023-01-24T21:37:22.500 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:37:23.390 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:01:53 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:37:25.550 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-24T21:37:25.551 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================================== 2023-01-24T21:37:25.551 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2023-01-24T21:37:25.552 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================================== 2023-01-24T21:37:25.552 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-24T21:37:25.552 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard noarch 2:17.2.5-727.g49f8fb05.el8 ceph-noarch 1.6 M 2023-01-24T21:37:25.552 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2023-01-24T21:37:25.553 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards noarch 2:17.2.5-727.g49f8fb05.el8 ceph-noarch 23 k 2023-01-24T21:37:25.553 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts noarch 2:17.2.5-727.g49f8fb05.el8 ceph-noarch 14 k 2023-01-24T21:37:25.553 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-01-24T21:37:25.553 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-01-24T21:37:25.553 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-01-24T21:37:25.554 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:37:25.554 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-24T21:37:25.554 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================================== 2023-01-24T21:37:25.554 INFO:teuthology.orchestra.run.smithi007.stdout:Install 6 Packages 2023-01-24T21:37:25.554 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:37:25.555 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 2.0 M 2023-01-24T21:37:25.555 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 7.8 M 2023-01-24T21:37:25.555 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-24T21:37:25.674 INFO:teuthology.orchestra.run.smithi007.stdout:(1/6): ceph-grafana-dashboards-17.2.5-727.g49f8 190 kB/s | 23 kB 00:00 2023-01-24T21:37:25.684 INFO:teuthology.orchestra.run.smithi007.stdout:(2/6): ceph-prometheus-alerts-17.2.5-727.g49f8f 111 kB/s | 14 kB 00:00 2023-01-24T21:37:25.761 INFO:teuthology.orchestra.run.smithi007.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 391 kB/s | 34 kB 00:00 2023-01-24T21:37:25.792 INFO:teuthology.orchestra.run.smithi007.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.3 MB/s | 43 kB 00:00 2023-01-24T21:37:25.824 INFO:teuthology.orchestra.run.smithi007.stdout:(5/6): ceph-mgr-dashboard-17.2.5-727.g49f8fb05. 6.1 MB/s | 1.6 MB 00:00 2023-01-24T21:37:25.843 INFO:teuthology.orchestra.run.smithi007.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.2 MB/s | 196 kB 00:00 2023-01-24T21:37:25.845 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-24T21:37:25.845 INFO:teuthology.orchestra.run.smithi007.stdout:Total 6.7 MB/s | 2.0 MB 00:00 2023-01-24T21:37:25.847 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-24T21:37:25.855 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-24T21:37:25.856 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-24T21:37:25.931 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-24T21:37:25.935 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-24T21:37:26.222 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-24T21:37:26.398 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 1/6 2023-01-24T21:37:26.610 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 2/6 2023-01-24T21:37:26.781 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 3/6 2023-01-24T21:37:26.919 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-prometheus-alerts-2:17.2.5-727.g49f8fb05.el8.no 4/6 2023-01-24T21:37:27.293 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-grafana-dashboards-2:17.2.5-727.g49f8fb05.el8.n 5/6 2023-01-24T21:37:27.534 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-dashboard-2:17.2.5-727.g49f8fb05.el8.noarch 6/6 2023-01-24T21:37:27.792 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.5-727.g49f8fb05.el8.noarch 6/6 2023-01-24T21:37:27.792 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-grafana-dashboards-2:17.2.5-727.g49f8fb05.el8.n 1/6 2023-01-24T21:37:27.792 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-dashboard-2:17.2.5-727.g49f8fb05.el8.noarch 2/6 2023-01-24T21:37:27.793 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-prometheus-alerts-2:17.2.5-727.g49f8fb05.el8.no 3/6 2023-01-24T21:37:27.793 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/6 2023-01-24T21:37:27.793 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/6 2023-01-24T21:37:28.882 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 6/6 2023-01-24T21:37:28.883 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:01:58 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:37:31.049 INFO:teuthology.orchestra.run.smithi007.stdout:Installed products updated. 2023-01-24T21:37:31.155 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:37:31.155 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-24T21:37:31.156 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards-2:17.2.5-727.g49f8fb05.el8.noarch 2023-01-24T21:37:31.156 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard-2:17.2.5-727.g49f8fb05.el8.noarch 2023-01-24T21:37:31.156 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts-2:17.2.5-727.g49f8fb05.el8.noarch 2023-01-24T21:37:31.156 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-01-24T21:37:31.156 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-01-24T21:37:31.157 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes-2.4.1-12.el8.noarch 2023-01-24T21:37:31.157 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:37:31.157 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-24T21:37:31.270 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-mgr-diskprediction-local 2023-01-24T21:37:31.649 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:37:32.563 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:02:02 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:37:34.434 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-24T21:37:34.435 INFO:teuthology.orchestra.run.smithi007.stdout:====================================================================================================================== 2023-01-24T21:37:34.436 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2023-01-24T21:37:34.436 INFO:teuthology.orchestra.run.smithi007.stdout:====================================================================================================================== 2023-01-24T21:37:34.436 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-24T21:37:34.436 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.5-727.g49f8fb05.el8 ceph-noarch 7.4 M 2023-01-24T21:37:34.437 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2023-01-24T21:37:34.437 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-01-24T21:37:34.437 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-01-24T21:37:34.437 INFO:teuthology.orchestra.run.smithi007.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-01-24T21:37:34.437 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-01-24T21:37:34.438 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-01-24T21:37:34.438 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-01-24T21:37:34.438 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-01-24T21:37:34.438 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:37:34.439 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-24T21:37:34.439 INFO:teuthology.orchestra.run.smithi007.stdout:====================================================================================================================== 2023-01-24T21:37:34.439 INFO:teuthology.orchestra.run.smithi007.stdout:Install 8 Packages 2023-01-24T21:37:34.439 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:37:34.440 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 36 M 2023-01-24T21:37:34.441 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 199 M 2023-01-24T21:37:34.441 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-24T21:37:34.474 INFO:teuthology.orchestra.run.smithi007.stdout:(1/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 6.2 MB/s | 225 kB 00:00 2023-01-24T21:37:34.554 INFO:teuthology.orchestra.run.smithi007.stdout:(2/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 47 MB/s | 3.7 MB 00:00 2023-01-24T21:37:34.647 INFO:teuthology.orchestra.run.smithi007.stdout:(3/8): openblas-threads-0.3.12-1.el8.x86_64.rpm 51 MB/s | 4.7 MB 00:00 2023-01-24T21:37:34.804 INFO:teuthology.orchestra.run.smithi007.stdout:(4/8): python3-scipy-1.0.0-20.module+el8.1.0+33 40 MB/s | 15 MB 00:00 2023-01-24T21:37:34.821 INFO:teuthology.orchestra.run.smithi007.stdout:(5/8): libquadmath-8.4.1-1.el8.x86_64.rpm 9.9 MB/s | 169 kB 00:00 2023-01-24T21:37:34.846 INFO:teuthology.orchestra.run.smithi007.stdout:(6/8): openblas-0.3.12-1.el8.x86_64.rpm 23 MB/s | 4.6 MB 00:00 2023-01-24T21:37:34.854 INFO:teuthology.orchestra.run.smithi007.stdout:(7/8): libgfortran-8.4.1-1.el8.x86_64.rpm 19 MB/s | 639 kB 00:00 2023-01-24T21:37:34.990 INFO:teuthology.orchestra.run.smithi007.stdout:(8/8): ceph-mgr-diskprediction-local-17.2.5-727 13 MB/s | 7.4 MB 00:00 2023-01-24T21:37:34.991 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-24T21:37:34.991 INFO:teuthology.orchestra.run.smithi007.stdout:Total 65 MB/s | 36 MB 00:00 2023-01-24T21:37:35.001 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-24T21:37:35.022 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-24T21:37:35.022 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-24T21:37:35.466 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-24T21:37:35.470 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-24T21:37:36.084 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-24T21:37:36.251 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 1/8 2023-01-24T21:37:36.375 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 1/8 2023-01-24T21:37:36.551 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 2/8 2023-01-24T21:37:37.136 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 2/8 2023-01-24T21:37:37.318 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 3/8 2023-01-24T21:37:37.894 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 3/8 2023-01-24T21:37:38.068 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-0.3.12-1.el8.x86_64 4/8 2023-01-24T21:37:38.835 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 4/8 2023-01-24T21:37:39.296 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2023-01-24T21:37:39.517 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2023-01-24T21:37:41.720 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2023-01-24T21:37:43.014 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 7/8 2023-01-24T21:37:43.166 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.5-727.g49f8fb05 8/8 2023-01-24T21:37:43.476 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.5-727.g49f8fb05 8/8 2023-01-24T21:37:43.477 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.5-727.g49f8fb05 1/8 2023-01-24T21:37:43.477 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 2/8 2023-01-24T21:37:43.477 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 3/8 2023-01-24T21:37:43.477 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2023-01-24T21:37:43.477 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 5/8 2023-01-24T21:37:43.478 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 6/8 2023-01-24T21:37:43.478 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 7/8 2023-01-24T21:37:44.569 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 8/8 2023-01-24T21:37:44.569 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:02:14 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:37:46.480 INFO:teuthology.orchestra.run.smithi007.stdout:Installed products updated. 2023-01-24T21:37:46.591 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:37:46.591 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-24T21:37:46.591 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local-2:17.2.5-727.g49f8fb05.el8.noarch 2023-01-24T21:37:46.591 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-01-24T21:37:46.592 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-01-24T21:37:46.592 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-0.3.12-1.el8.x86_64 2023-01-24T21:37:46.592 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-01-24T21:37:46.592 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-01-24T21:37:46.593 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-01-24T21:37:46.593 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-01-24T21:37:46.593 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:37:46.593 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-24T21:37:46.741 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-mgr-rook 2023-01-24T21:37:47.124 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:37:48.020 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:02:18 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:37:49.878 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-24T21:37:49.880 INFO:teuthology.orchestra.run.smithi007.stdout:======================================================================================================= 2023-01-24T21:37:49.880 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2023-01-24T21:37:49.880 INFO:teuthology.orchestra.run.smithi007.stdout:======================================================================================================= 2023-01-24T21:37:49.880 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-24T21:37:49.881 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook noarch 2:17.2.5-727.g49f8fb05.el8 ceph-noarch 47 k 2023-01-24T21:37:49.881 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2023-01-24T21:37:49.881 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-01-24T21:37:49.881 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-01-24T21:37:49.881 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-01-24T21:37:49.882 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-01-24T21:37:49.882 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-01-24T21:37:49.882 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-01-24T21:37:49.882 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-01-24T21:37:49.883 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-01-24T21:37:49.883 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-01-24T21:37:49.883 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-01-24T21:37:49.883 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-01-24T21:37:49.883 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-01-24T21:37:49.884 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:37:49.884 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-24T21:37:49.884 INFO:teuthology.orchestra.run.smithi007.stdout:======================================================================================================= 2023-01-24T21:37:49.884 INFO:teuthology.orchestra.run.smithi007.stdout:Install 13 Packages 2023-01-24T21:37:49.885 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:37:49.885 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 1.9 M 2023-01-24T21:37:49.885 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 25 M 2023-01-24T21:37:49.886 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-24T21:37:49.966 INFO:teuthology.orchestra.run.smithi007.stdout:(1/13): python3-certifi-2018.10.15-7.el8.noarch 196 kB/s | 16 kB 00:00 2023-01-24T21:37:49.967 INFO:teuthology.orchestra.run.smithi007.stdout:(2/13): python3-cachetools-3.1.1-4.el8.noarch.r 394 kB/s | 33 kB 00:00 2023-01-24T21:37:50.021 INFO:teuthology.orchestra.run.smithi007.stdout:(3/13): python3-google-auth-1.1.1-10.el8.noarch 1.5 MB/s | 81 kB 00:00 2023-01-24T21:37:50.026 INFO:teuthology.orchestra.run.smithi007.stdout:(4/13): ceph-mgr-rook-17.2.5-727.g49f8fb05.el8. 329 kB/s | 47 kB 00:00 2023-01-24T21:37:50.050 INFO:teuthology.orchestra.run.smithi007.stdout:(5/13): python3-rsa-4.8-1.el8.noarch.rpm 2.1 MB/s | 61 kB 00:00 2023-01-24T21:37:50.081 INFO:teuthology.orchestra.run.smithi007.stdout:(6/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 886 kB/s | 27 kB 00:00 2023-01-24T21:37:50.093 INFO:teuthology.orchestra.run.smithi007.stdout:(7/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 9.7 MB/s | 126 kB 00:00 2023-01-24T21:37:50.107 INFO:teuthology.orchestra.run.smithi007.stdout:(8/13): python3-pyasn1-modules-0.3.7-6.el8.noar 8.4 MB/s | 110 kB 00:00 2023-01-24T21:37:50.118 INFO:teuthology.orchestra.run.smithi007.stdout:(9/13): python3-jsonpointer-1.10-11.el8.noarch. 1.7 MB/s | 20 kB 00:00 2023-01-24T21:37:50.131 INFO:teuthology.orchestra.run.smithi007.stdout:(10/13): python3-oauthlib-2.1.0-1.el8.noarch.rp 12 MB/s | 155 kB 00:00 2023-01-24T21:37:50.143 INFO:teuthology.orchestra.run.smithi007.stdout:(11/13): python3-requests-oauthlib-1.0.0-1.el8. 3.4 MB/s | 43 kB 00:00 2023-01-24T21:37:50.164 INFO:teuthology.orchestra.run.smithi007.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 442 kB/s | 61 kB 00:00 2023-01-24T21:37:50.412 INFO:teuthology.orchestra.run.smithi007.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 2.6 MB/s | 1.2 MB 00:00 2023-01-24T21:37:50.412 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-24T21:37:50.413 INFO:teuthology.orchestra.run.smithi007.stdout:Total 3.6 MB/s | 1.9 MB 00:00 2023-01-24T21:37:50.419 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-24T21:37:50.434 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-24T21:37:50.434 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-24T21:37:50.532 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-24T21:37:50.536 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-24T21:37:51.161 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-24T21:37:51.431 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-01-24T21:37:51.668 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rsa-4.8-1.el8.noarch 2/13 2023-01-24T21:37:51.932 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/13 2023-01-24T21:37:52.208 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 4/13 2023-01-24T21:37:52.415 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 5/13 2023-01-24T21:37:52.642 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 6/13 2023-01-24T21:37:52.827 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 7/13 2023-01-24T21:37:53.076 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 8/13 2023-01-24T21:37:53.254 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-01-24T21:37:53.485 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 10/13 2023-01-24T21:37:54.830 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 11/13 2023-01-24T21:37:55.186 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 12/13 2023-01-24T21:37:55.306 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-rook-2:17.2.5-727.g49f8fb05.el8.noarch 13/13 2023-01-24T21:37:55.586 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.5-727.g49f8fb05.el8.noarch 13/13 2023-01-24T21:37:55.586 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-rook-2:17.2.5-727.g49f8fb05.el8.noarch 1/13 2023-01-24T21:37:55.586 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 2/13 2023-01-24T21:37:55.586 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 3/13 2023-01-24T21:37:55.587 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 4/13 2023-01-24T21:37:55.587 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 5/13 2023-01-24T21:37:55.587 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 6/13 2023-01-24T21:37:55.587 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 7/13 2023-01-24T21:37:55.587 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 8/13 2023-01-24T21:37:55.588 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 9/13 2023-01-24T21:37:55.588 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 10/13 2023-01-24T21:37:55.588 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-01-24T21:37:55.588 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 12/13 2023-01-24T21:37:56.709 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 13/13 2023-01-24T21:37:56.709 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:02:26 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:37:59.052 INFO:teuthology.orchestra.run.smithi007.stdout:Installed products updated. 2023-01-24T21:37:59.161 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:37:59.161 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-24T21:37:59.162 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook-2:17.2.5-727.g49f8fb05.el8.noarch 2023-01-24T21:37:59.162 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-01-24T21:37:59.162 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-01-24T21:37:59.162 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-01-24T21:37:59.163 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-01-24T21:37:59.163 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-01-24T21:37:59.163 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-01-24T21:37:59.163 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-01-24T21:37:59.163 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-01-24T21:37:59.164 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-01-24T21:37:59.164 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-01-24T21:37:59.164 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa-4.8-1.el8.noarch 2023-01-24T21:37:59.164 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-01-24T21:37:59.164 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:37:59.165 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-24T21:37:59.295 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-mgr-cephadm 2023-01-24T21:37:59.683 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:38:00.565 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:02:30 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:38:02.408 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-24T21:38:02.408 INFO:teuthology.orchestra.run.smithi007.stdout:============================================================================================== 2023-01-24T21:38:02.409 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2023-01-24T21:38:02.409 INFO:teuthology.orchestra.run.smithi007.stdout:============================================================================================== 2023-01-24T21:38:02.409 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-24T21:38:02.410 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm noarch 2:17.2.5-727.g49f8fb05.el8 ceph-noarch 115 k 2023-01-24T21:38:02.410 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2023-01-24T21:38:02.410 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-01-24T21:38:02.410 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-01-24T21:38:02.411 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-01-24T21:38:02.411 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-01-24T21:38:02.411 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:38:02.411 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-24T21:38:02.411 INFO:teuthology.orchestra.run.smithi007.stdout:============================================================================================== 2023-01-24T21:38:02.412 INFO:teuthology.orchestra.run.smithi007.stdout:Install 5 Packages 2023-01-24T21:38:02.412 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:38:02.413 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 5.9 M 2023-01-24T21:38:02.413 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 26 M 2023-01-24T21:38:02.413 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-24T21:38:02.521 INFO:teuthology.orchestra.run.smithi007.stdout:(1/5): python3-natsort-7.1.1-2.el8.noarch.rpm 545 kB/s | 60 kB 00:00 2023-01-24T21:38:02.577 INFO:teuthology.orchestra.run.smithi007.stdout:(2/5): ceph-mgr-cephadm-17.2.5-727.g49f8fb05.el 692 kB/s | 115 kB 00:00 2023-01-24T21:38:02.625 INFO:teuthology.orchestra.run.smithi007.stdout:(3/5): python3-babel-2.5.1-5.el8.noarch.rpm 47 MB/s | 4.8 MB 00:00 2023-01-24T21:38:02.631 INFO:teuthology.orchestra.run.smithi007.stdout:(4/5): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 9.8 MB/s | 538 kB 00:00 2023-01-24T21:38:02.676 INFO:teuthology.orchestra.run.smithi007.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.8 MB/s | 476 kB 00:00 2023-01-24T21:38:02.678 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-24T21:38:02.678 INFO:teuthology.orchestra.run.smithi007.stdout:Total 22 MB/s | 5.9 MB 00:00 2023-01-24T21:38:02.681 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-24T21:38:02.692 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-24T21:38:02.692 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-24T21:38:02.790 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-24T21:38:02.795 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-24T21:38:03.976 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-24T21:38:04.328 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 1/5 2023-01-24T21:38:04.569 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 2/5 2023-01-24T21:38:04.906 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 3/5 2023-01-24T21:38:05.169 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-01-24T21:38:05.330 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-cephadm-2:17.2.5-727.g49f8fb05.el8.noarch 5/5 2023-01-24T21:38:05.608 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.5-727.g49f8fb05.el8.noarch 5/5 2023-01-24T21:38:05.608 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-cephadm-2:17.2.5-727.g49f8fb05.el8.noarch 1/5 2023-01-24T21:38:05.609 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-01-24T21:38:05.609 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 3/5 2023-01-24T21:38:05.609 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 4/5 2023-01-24T21:38:06.638 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 5/5 2023-01-24T21:38:06.639 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:02:36 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:38:08.617 INFO:teuthology.orchestra.run.smithi007.stdout:Installed products updated. 2023-01-24T21:38:08.726 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:38:08.726 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-24T21:38:08.726 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm-2:17.2.5-727.g49f8fb05.el8.noarch 2023-01-24T21:38:08.726 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-01-24T21:38:08.727 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel-2.5.1-5.el8.noarch 2023-01-24T21:38:08.727 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-01-24T21:38:08.727 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-01-24T21:38:08.727 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:38:08.727 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-24T21:38:08.844 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-fuse 2023-01-24T21:38:09.235 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:38:10.142 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:02:40 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:38:12.001 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-24T21:38:12.002 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-24T21:38:12.002 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2023-01-24T21:38:12.002 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-24T21:38:12.002 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-24T21:38:12.003 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse 2023-01-24T21:38:12.003 INFO:teuthology.orchestra.run.smithi007.stdout: x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 872 k 2023-01-24T21:38:12.003 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2023-01-24T21:38:12.003 INFO:teuthology.orchestra.run.smithi007.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-01-24T21:38:12.003 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:38:12.004 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-24T21:38:12.004 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-24T21:38:12.004 INFO:teuthology.orchestra.run.smithi007.stdout:Install 2 Packages 2023-01-24T21:38:12.004 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:38:12.005 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 954 k 2023-01-24T21:38:12.005 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 3.0 M 2023-01-24T21:38:12.005 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-24T21:38:12.043 INFO:teuthology.orchestra.run.smithi007.stdout:(1/2): fuse-2.9.7-12.el8.x86_64.rpm 2.0 MB/s | 83 kB 00:00 2023-01-24T21:38:12.332 INFO:teuthology.orchestra.run.smithi007.stdout:(2/2): ceph-fuse-17.2.5-727.g49f8fb05.el8.x86_6 2.6 MB/s | 872 kB 00:00 2023-01-24T21:38:12.333 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-24T21:38:12.333 INFO:teuthology.orchestra.run.smithi007.stdout:Total 2.8 MB/s | 954 kB 00:00 2023-01-24T21:38:12.335 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-24T21:38:12.359 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-24T21:38:12.359 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-24T21:38:12.451 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-24T21:38:12.456 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-24T21:38:13.633 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-24T21:38:13.885 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2023-01-24T21:38:14.171 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-fuse-2:17.2.5-727.g49f8fb05.el8.x86_64 2/2 2023-01-24T21:38:14.563 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-fuse-2:17.2.5-727.g49f8fb05.el8.x86_64 2/2 2023-01-24T21:38:14.563 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-fuse-2:17.2.5-727.g49f8fb05.el8.x86_64 1/2 2023-01-24T21:38:15.638 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2023-01-24T21:38:15.638 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:02:45 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:38:17.561 INFO:teuthology.orchestra.run.smithi007.stdout:Installed products updated. 2023-01-24T21:38:17.668 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:38:17.668 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-24T21:38:17.668 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse-2:17.2.5-727.g49f8fb05.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2023-01-24T21:38:17.669 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:38:17.669 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-24T21:38:17.784 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-volume 2023-01-24T21:38:18.176 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:38:19.126 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:02:49 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:38:20.998 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-24T21:38:20.999 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-24T21:38:20.999 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2023-01-24T21:38:20.999 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-24T21:38:21.000 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-24T21:38:21.000 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume noarch 2:17.2.5-727.g49f8fb05.el8 ceph-noarch 263 k 2023-01-24T21:38:21.000 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:38:21.000 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-24T21:38:21.000 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-24T21:38:21.001 INFO:teuthology.orchestra.run.smithi007.stdout:Install 1 Package 2023-01-24T21:38:21.001 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:38:21.001 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 263 k 2023-01-24T21:38:21.001 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 1.3 M 2023-01-24T21:38:21.001 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-24T21:38:21.190 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-volume-17.2.5-727.g49f8fb05.el8.noarch.rpm 1.3 MB/s | 263 kB 00:00 2023-01-24T21:38:21.191 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-24T21:38:21.192 INFO:teuthology.orchestra.run.smithi007.stdout:Total 1.3 MB/s | 263 kB 00:00 2023-01-24T21:38:21.192 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-24T21:38:21.203 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-24T21:38:21.203 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-24T21:38:21.227 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-24T21:38:21.232 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-24T21:38:21.422 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-24T21:38:21.694 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-volume-2:17.2.5-727.g49f8fb05.el8.noarch 1/1 2023-01-24T21:38:22.122 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-volume-2:17.2.5-727.g49f8fb05.el8.noarch 1/1 2023-01-24T21:38:23.160 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-volume-2:17.2.5-727.g49f8fb05.el8.noarch 1/1 2023-01-24T21:38:23.161 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:02:53 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:38:25.188 INFO:teuthology.orchestra.run.smithi007.stdout:Installed products updated. 2023-01-24T21:38:25.293 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:38:25.293 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-24T21:38:25.293 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume-2:17.2.5-727.g49f8fb05.el8.noarch 2023-01-24T21:38:25.294 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:38:25.294 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-24T21:38:25.420 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install librados-devel 2023-01-24T21:38:25.811 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:38:26.667 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:02:56 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:38:28.618 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-24T21:38:28.618 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-24T21:38:28.619 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repo Size 2023-01-24T21:38:28.619 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-24T21:38:28.619 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-24T21:38:28.620 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 130 k 2023-01-24T21:38:28.620 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:38:28.620 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-24T21:38:28.620 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-24T21:38:28.621 INFO:teuthology.orchestra.run.smithi007.stdout:Install 1 Package 2023-01-24T21:38:28.621 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:38:28.621 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 130 k 2023-01-24T21:38:28.621 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 464 k 2023-01-24T21:38:28.621 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-24T21:38:28.785 INFO:teuthology.orchestra.run.smithi007.stdout:librados-devel-17.2.5-727.g49f8fb05.el8.x86_64. 783 kB/s | 130 kB 00:00 2023-01-24T21:38:28.786 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-24T21:38:28.786 INFO:teuthology.orchestra.run.smithi007.stdout:Total 776 kB/s | 130 kB 00:00 2023-01-24T21:38:28.787 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-24T21:38:28.794 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-24T21:38:28.794 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-24T21:38:28.853 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-24T21:38:28.858 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-24T21:38:28.985 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-24T21:38:29.368 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librados-devel-2:17.2.5-727.g49f8fb05.el8.x86_64 1/1 2023-01-24T21:38:29.726 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados-devel-2:17.2.5-727.g49f8fb05.el8.x86_64 1/1 2023-01-24T21:38:30.780 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados-devel-2:17.2.5-727.g49f8fb05.el8.x86_64 1/1 2023-01-24T21:38:30.780 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:03:00 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:38:32.966 INFO:teuthology.orchestra.run.smithi007.stdout:Installed products updated. 2023-01-24T21:38:33.073 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:38:33.074 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-24T21:38:33.074 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:38:33.074 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:38:33.074 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-24T21:38:33.197 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install libcephfs2 2023-01-24T21:38:33.591 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:38:34.679 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:03:04 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:38:36.054 INFO:teuthology.orchestra.run.smithi007.stdout:Package libcephfs2-2:17.2.5-727.g49f8fb05.el8.x86_64 is already installed. 2023-01-24T21:38:36.530 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-24T21:38:36.531 INFO:teuthology.orchestra.run.smithi007.stdout:Nothing to do. 2023-01-24T21:38:36.531 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-24T21:38:36.635 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install libcephfs-devel 2023-01-24T21:38:37.024 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:38:37.982 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:03:07 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:38:39.872 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-24T21:38:39.872 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-24T21:38:39.873 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repo Size 2023-01-24T21:38:39.873 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-24T21:38:39.873 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-24T21:38:39.873 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 25 k 2023-01-24T21:38:39.874 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:38:39.874 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-24T21:38:39.874 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-24T21:38:39.874 INFO:teuthology.orchestra.run.smithi007.stdout:Install 1 Package 2023-01-24T21:38:39.875 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:38:39.875 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 25 k 2023-01-24T21:38:39.875 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 109 k 2023-01-24T21:38:39.875 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-24T21:38:40.088 INFO:teuthology.orchestra.run.smithi007.stdout:libcephfs-devel-17.2.5-727.g49f8fb05.el8.x86_64 116 kB/s | 25 kB 00:00 2023-01-24T21:38:40.089 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-24T21:38:40.089 INFO:teuthology.orchestra.run.smithi007.stdout:Total 115 kB/s | 25 kB 00:00 2023-01-24T21:38:40.090 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-24T21:38:40.093 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-24T21:38:40.093 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-24T21:38:40.095 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-24T21:38:40.100 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-24T21:38:40.148 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-24T21:38:40.373 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs-devel-2:17.2.5-727.g49f8fb05.el8.x86_64 1/1 2023-01-24T21:38:40.627 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephfs-devel-2:17.2.5-727.g49f8fb05.el8.x86_64 1/1 2023-01-24T21:38:41.653 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs-devel-2:17.2.5-727.g49f8fb05.el8.x86_64 1/1 2023-01-24T21:38:41.654 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:03:11 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:38:43.595 INFO:teuthology.orchestra.run.smithi007.stdout:Installed products updated. 2023-01-24T21:38:43.700 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:38:43.701 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-24T21:38:43.701 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:38:43.701 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:38:43.701 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-24T21:38:43.807 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install librados2 2023-01-24T21:38:44.200 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:38:45.097 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:03:15 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:38:46.486 INFO:teuthology.orchestra.run.smithi007.stdout:Package librados2-2:17.2.5-727.g49f8fb05.el8.x86_64 is already installed. 2023-01-24T21:38:46.968 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-24T21:38:46.969 INFO:teuthology.orchestra.run.smithi007.stdout:Nothing to do. 2023-01-24T21:38:46.969 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-24T21:38:47.071 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install librbd1 2023-01-24T21:38:47.462 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:38:48.488 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:03:18 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:38:49.886 INFO:teuthology.orchestra.run.smithi007.stdout:Package librbd1-2:17.2.5-727.g49f8fb05.el8.x86_64 is already installed. 2023-01-24T21:38:50.373 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-24T21:38:50.374 INFO:teuthology.orchestra.run.smithi007.stdout:Nothing to do. 2023-01-24T21:38:50.374 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-24T21:38:50.470 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install python3-rados 2023-01-24T21:38:50.860 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:38:51.737 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:03:21 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:38:53.210 INFO:teuthology.orchestra.run.smithi007.stdout:Package python3-rados-2:17.2.5-727.g49f8fb05.el8.x86_64 is already installed. 2023-01-24T21:38:53.684 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-24T21:38:53.685 INFO:teuthology.orchestra.run.smithi007.stdout:Nothing to do. 2023-01-24T21:38:53.685 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-24T21:38:53.783 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install python3-rgw 2023-01-24T21:38:54.172 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:38:55.083 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:03:25 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:38:56.485 INFO:teuthology.orchestra.run.smithi007.stdout:Package python3-rgw-2:17.2.5-727.g49f8fb05.el8.x86_64 is already installed. 2023-01-24T21:38:56.970 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-24T21:38:56.971 INFO:teuthology.orchestra.run.smithi007.stdout:Nothing to do. 2023-01-24T21:38:56.971 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-24T21:38:57.076 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install python3-cephfs 2023-01-24T21:38:57.466 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:38:58.470 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:03:28 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:38:59.875 INFO:teuthology.orchestra.run.smithi007.stdout:Package python3-cephfs-2:17.2.5-727.g49f8fb05.el8.x86_64 is already installed. 2023-01-24T21:39:00.358 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-24T21:39:00.359 INFO:teuthology.orchestra.run.smithi007.stdout:Nothing to do. 2023-01-24T21:39:00.359 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-24T21:39:00.467 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install python3-rbd 2023-01-24T21:39:00.857 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:39:01.741 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:03:31 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:39:03.117 INFO:teuthology.orchestra.run.smithi007.stdout:Package python3-rbd-2:17.2.5-727.g49f8fb05.el8.x86_64 is already installed. 2023-01-24T21:39:03.598 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-24T21:39:03.600 INFO:teuthology.orchestra.run.smithi007.stdout:Nothing to do. 2023-01-24T21:39:03.600 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-24T21:39:03.690 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install rbd-fuse 2023-01-24T21:39:04.080 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:39:04.982 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:03:34 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:39:06.853 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-24T21:39:06.854 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-24T21:39:06.854 INFO:teuthology.orchestra.run.smithi007.stdout: Package Architecture Version Repository Size 2023-01-24T21:39:06.855 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-24T21:39:06.855 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-24T21:39:06.855 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 90 k 2023-01-24T21:39:06.856 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:06.856 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-24T21:39:06.856 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-24T21:39:06.856 INFO:teuthology.orchestra.run.smithi007.stdout:Install 1 Package 2023-01-24T21:39:06.856 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:06.857 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 90 k 2023-01-24T21:39:06.857 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 264 k 2023-01-24T21:39:06.857 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-24T21:39:07.021 INFO:teuthology.orchestra.run.smithi007.stdout:rbd-fuse-17.2.5-727.g49f8fb05.el8.x86_64.rpm 544 kB/s | 90 kB 00:00 2023-01-24T21:39:07.021 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-24T21:39:07.022 INFO:teuthology.orchestra.run.smithi007.stdout:Total 539 kB/s | 90 kB 00:00 2023-01-24T21:39:07.022 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-24T21:39:07.035 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-24T21:39:07.035 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-24T21:39:07.095 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-24T21:39:07.100 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-24T21:39:07.217 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-24T21:39:07.386 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-fuse-2:17.2.5-727.g49f8fb05.el8.x86_64 1/1 2023-01-24T21:39:07.660 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: rbd-fuse-2:17.2.5-727.g49f8fb05.el8.x86_64 1/1 2023-01-24T21:39:08.727 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-fuse-2:17.2.5-727.g49f8fb05.el8.x86_64 1/1 2023-01-24T21:39:08.727 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:03:38 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:39:10.795 INFO:teuthology.orchestra.run.smithi007.stdout:Installed products updated. 2023-01-24T21:39:10.899 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:10.900 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-24T21:39:10.900 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:39:10.900 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:10.901 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-24T21:39:11.012 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install rbd-mirror 2023-01-24T21:39:11.404 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:39:12.283 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:03:42 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:39:14.156 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-24T21:39:14.157 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-24T21:39:14.157 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repo Size 2023-01-24T21:39:14.158 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-24T21:39:14.158 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-24T21:39:14.158 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 3.5 M 2023-01-24T21:39:14.158 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:14.158 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-24T21:39:14.159 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-24T21:39:14.159 INFO:teuthology.orchestra.run.smithi007.stdout:Install 1 Package 2023-01-24T21:39:14.159 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:14.159 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 3.5 M 2023-01-24T21:39:14.160 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 16 M 2023-01-24T21:39:14.160 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-24T21:39:14.493 INFO:teuthology.orchestra.run.smithi007.stdout:rbd-mirror-17.2.5-727.g49f8fb05.el8.x86_64.rpm 10 MB/s | 3.5 MB 00:00 2023-01-24T21:39:14.494 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-24T21:39:14.495 INFO:teuthology.orchestra.run.smithi007.stdout:Total 10 MB/s | 3.5 MB 00:00 2023-01-24T21:39:14.495 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-24T21:39:14.510 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-24T21:39:14.510 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-24T21:39:14.582 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-24T21:39:14.586 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-24T21:39:15.060 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-24T21:39:15.218 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-mirror-2:17.2.5-727.g49f8fb05.el8.x86_64 1/1 2023-01-24T21:39:15.652 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: rbd-mirror-2:17.2.5-727.g49f8fb05.el8.x86_64 1/1 2023-01-24T21:39:16.856 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-mirror-2:17.2.5-727.g49f8fb05.el8.x86_64 1/1 2023-01-24T21:39:16.856 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:03:46 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:39:18.872 INFO:teuthology.orchestra.run.smithi007.stdout:Installed products updated. 2023-01-24T21:39:18.979 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:18.979 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-24T21:39:18.980 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:39:18.980 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:18.980 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-24T21:39:19.091 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install rbd-nbd 2023-01-24T21:39:19.487 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-01-24T21:39:20.350 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:03:50 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:39:22.246 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-24T21:39:22.246 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-24T21:39:22.246 INFO:teuthology.orchestra.run.smithi007.stdout: Package Architecture Version Repository Size 2023-01-24T21:39:22.247 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-24T21:39:22.247 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-24T21:39:22.247 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd x86_64 2:17.2.5-727.g49f8fb05.el8 ceph 172 k 2023-01-24T21:39:22.247 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:22.248 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-24T21:39:22.248 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-24T21:39:22.248 INFO:teuthology.orchestra.run.smithi007.stdout:Install 1 Package 2023-01-24T21:39:22.248 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:22.249 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 172 k 2023-01-24T21:39:22.249 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 548 k 2023-01-24T21:39:22.249 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-24T21:39:22.581 INFO:teuthology.orchestra.run.smithi007.stdout:rbd-nbd-17.2.5-727.g49f8fb05.el8.x86_64.rpm 513 kB/s | 172 kB 00:00 2023-01-24T21:39:22.583 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-24T21:39:22.583 INFO:teuthology.orchestra.run.smithi007.stdout:Total 511 kB/s | 172 kB 00:00 2023-01-24T21:39:22.583 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-24T21:39:22.596 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-24T21:39:22.597 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-24T21:39:22.656 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-24T21:39:22.660 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-24T21:39:22.789 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-24T21:39:22.966 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-nbd-2:17.2.5-727.g49f8fb05.el8.x86_64 1/1 2023-01-24T21:39:23.261 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: rbd-nbd-2:17.2.5-727.g49f8fb05.el8.x86_64 1/1 2023-01-24T21:39:24.349 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-nbd-2:17.2.5-727.g49f8fb05.el8.x86_64 1/1 2023-01-24T21:39:24.350 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:03:54 ago on Tue 24 Jan 2023 09:35:30 PM UTC. 2023-01-24T21:39:26.357 INFO:teuthology.orchestra.run.smithi007.stdout:Installed products updated. 2023-01-24T21:39:26.464 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:26.465 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-24T21:39:26.465 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd-2:17.2.5-727.g49f8fb05.el8.x86_64 2023-01-24T21:39:26.465 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:26.465 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-24T21:39:26.573 DEBUG:teuthology.parallel:result is None 2023-01-24T21:39:26.573 DEBUG:teuthology.orchestra.run.smithi007:> sudo lsb_release -is 2023-01-24T21:39:26.613 INFO:teuthology.orchestra.run.smithi007.stdout:RedHatEnterprise 2023-01-24T21:39:26.614 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2023-01-24T21:39:26.615 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=49f8fb05584886826e8eade75f7105fba754560c 2023-01-24T21:39:26.768 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-01-24T21:39:26.788 INFO:teuthology.orchestra.run.smithi007.stdout:17.2.5-727.g49f8fb05.el8 2023-01-24T21:39:26.789 INFO:teuthology.packaging:The installed version of ceph is 17.2.5-727.g49f8fb05.el8 2023-01-24T21:39:26.789 INFO:teuthology.task.install:The correct ceph version 17.2.5-727.g49f8fb05 is installed. 2023-01-24T21:39:26.790 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-01-24T21:39:26.790 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-24T21:39:26.790 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-24T21:39:26.853 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-01-24T21:39:26.854 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-24T21:39:26.854 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/daemon-helper 2023-01-24T21:39:26.918 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-24T21:39:26.983 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-01-24T21:39:26.983 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-24T21:39:26.984 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-24T21:39:27.047 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-24T21:39:27.111 INFO:teuthology.run_tasks:Running task ceph... 2023-01-24T21:39:27.174 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-01-24T21:39:27.175 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 777 /var/log/ceph 2023-01-24T21:39:27.199 INFO:tasks.ceph:Disabling ceph logrotate... 2023-01-24T21:39:27.200 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/logrotate.d/ceph 2023-01-24T21:39:27.263 INFO:tasks.ceph:Creating extra log directories... 2023-01-24T21:39:27.264 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-01-24T21:39:27.369 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-01-24T21:39:27.369 INFO:tasks.ceph:config {'conf': {'global': {'mon election default strategy': 1, 'ms bind msgr2': False, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['but it is still running', 'had wrong client addr', 'had wrong cluster addr', 'must scrub before tier agent can activate', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping updates', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(SMALLER_PG_NUM\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(FS_DEGRADED\\)', '\\(POOL_BACKFILLFULL\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(POOL_NEARFULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(AUTH_BAD_CAPS\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2023-01-24T21:39:27.370 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-01-24_16:05:13-rados-wip-yuri7-testing-2023-01-23-1532-quincy-distro-default-smithi/7135830', 'branch': 'wip-yuri7-testing-2023-01-23-1532-quincy', 'description': 'rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}}', 'email': 'yweinstein@radhat.com', 'first_in_suite': False, 'job_id': '7135830', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-01-24_16:05:13-rados-wip-yuri7-testing-2023-01-23-1532-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri7-testing-2023-01-23-1532-quincy'}, 'ceph': {'conf': {'global': {'mon election default strategy': 1, 'ms bind msgr2': False, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'mon_bind_msgr2': False, 'sha1': '49f8fb05584886826e8eade75f7105fba754560c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '49f8fb05584886826e8eade75f7105fba754560c'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri7-testing-2023-01-23-1532-quincy', 'sha1': '49f8fb05584886826e8eade75f7105fba754560c'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 71, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'sha1': '49f8fb05584886826e8eade75f7105fba754560c', 'sleep_before_teardown': 0, 'suite': 'rados', 'suite_branch': 'wip-yuri7-testing-2023-01-23-1532-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_49f8fb05584886826e8eade75f7105fba754560c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '49f8fb05584886826e8eade75f7105fba754560c', 'targets': {'smithi007.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDzT0EiDZGSIf7d+GRcvr1nI6p3YOzeNS9I2cu28BGneksDPUfcVJCKP0tNO7ytdjrH2AyJCiS+MbmosD1tq2EE4fijIIbtodPDKgO9hUWl+F1JNWLXC15VvqB3tEzeDhx5qATf0sSszhL4Qx+OZTpTx169ZwzNB1PpnhmAz/dl3iHxIxnzOhCgGiEH4oq26tNcdNrVCAhUua0ogCaLn7Q78L3sXq55DLf9XvUB3nUoJbAMFx2uPiKWqZJM60inYnrNnW0pSxXLYPQJOYx0yvMAy8hFUfYluuX6ffK8BBTbHbq+WFzRHHDn1M6BJfVHpLhg4OUkRQ7SZHtkMhewBtBG7TZrKRUru1nTROSFbS0/PqQvU2KXrQdfsXDGwVtyQ18bwg18fwg+iXwu+4Xwk5Kl2S49g6nTfFa/8kZsClv6NKn2P+O7Zgo2IAVLwZwYeBL4Yy2Z19PDQVcM4QHH6FFt6nrvtr45YsujIixapI7sGX4nWUElDI5kd1AUtQjeLKU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'log-ignorelist': ['but it is still running', 'had wrong client addr', 'had wrong cluster addr', 'must scrub before tier agent can activate', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping updates', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(SMALLER_PG_NUM\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(FS_DEGRADED\\)', '\\(POOL_BACKFILLFULL\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(POOL_NEARFULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(AUTH_BAD_CAPS\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'conf': {'global': {'mon election default strategy': 1, 'ms bind msgr2': False, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'mon_bind_msgr2': False, 'sha1': '49f8fb05584886826e8eade75f7105fba754560c', 'cluster': 'ceph'}}, {'workunit': {'clients': {'all': ['cephtool', 'mon/pool_ops.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '8e1bba12e584b7ae912e92e94afe9c075ab51fa3', 'timestamp': '2023-01-24_16:05:13', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.17735'} 2023-01-24T21:39:27.370 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-01-24T21:39:27.385 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m0777 -- /var/run/ceph 2023-01-24T21:39:27.450 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-24T21:39:27.450 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/scratch_devs of=/dev/stdout 2023-01-24T21:39:27.504 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-01-24T21:39:27.505 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_1 2023-01-24T21:39:27.560 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-01-24T21:39:27.560 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-24T21:39:27.560 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 205991 Links: 1 2023-01-24T21:39:27.560 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-24T21:39:27.561 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2023-01-24T21:39:27.561 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2023-01-24 21:39:15.408940025 +0000 2023-01-24T21:39:27.561 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2023-01-24 21:34:48.244148157 +0000 2023-01-24T21:39:27.561 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2023-01-24 21:34:48.244148157 +0000 2023-01-24T21:39:27.561 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: - 2023-01-24T21:39:27.562 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-01-24T21:39:27.624 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2023-01-24T21:39:27.624 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2023-01-24T21:39:27.624 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000114911 s, 4.5 MB/s 2023-01-24T21:39:27.625 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-01-24T21:39:27.680 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_2 2023-01-24T21:39:27.735 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-01-24T21:39:27.735 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-24T21:39:27.736 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 200308 Links: 1 2023-01-24T21:39:27.736 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-24T21:39:27.736 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2023-01-24T21:39:27.736 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2023-01-24 21:39:15.408940025 +0000 2023-01-24T21:39:27.737 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2023-01-24 21:34:48.739140579 +0000 2023-01-24T21:39:27.737 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2023-01-24 21:34:48.739140579 +0000 2023-01-24T21:39:27.737 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: - 2023-01-24T21:39:27.737 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-01-24T21:39:27.798 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2023-01-24T21:39:27.798 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2023-01-24T21:39:27.798 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 9.5592e-05 s, 5.4 MB/s 2023-01-24T21:39:27.799 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-01-24T21:39:27.855 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_3 2023-01-24T21:39:27.910 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-01-24T21:39:27.910 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-24T21:39:27.910 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 202467 Links: 1 2023-01-24T21:39:27.910 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-24T21:39:27.911 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2023-01-24T21:39:27.911 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2023-01-24 21:39:15.408940025 +0000 2023-01-24T21:39:27.911 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2023-01-24 21:34:49.232133032 +0000 2023-01-24T21:39:27.911 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2023-01-24 21:34:49.232133032 +0000 2023-01-24T21:39:27.911 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: - 2023-01-24T21:39:27.912 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-01-24T21:39:27.972 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2023-01-24T21:39:27.973 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2023-01-24T21:39:27.973 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000110372 s, 4.6 MB/s 2023-01-24T21:39:27.974 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-01-24T21:39:28.029 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_4 2023-01-24T21:39:28.085 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-01-24T21:39:28.085 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-24T21:39:28.086 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 200477 Links: 1 2023-01-24T21:39:28.086 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-24T21:39:28.087 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2023-01-24T21:39:28.087 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2023-01-24 21:39:15.408940025 +0000 2023-01-24T21:39:28.087 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2023-01-24 21:34:49.730125407 +0000 2023-01-24T21:39:28.088 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2023-01-24 21:34:49.730125407 +0000 2023-01-24T21:39:28.088 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: - 2023-01-24T21:39:28.088 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-01-24T21:39:28.148 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2023-01-24T21:39:28.148 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2023-01-24T21:39:28.149 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000108459 s, 4.7 MB/s 2023-01-24T21:39:28.150 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-01-24T21:39:28.205 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-01-24T21:39:28.205 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi007.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2023-01-24T21:39:28.206 INFO:tasks.ceph:Generating config... 2023-01-24T21:39:28.207 INFO:tasks.ceph:[global] mon election default strategy = 1 2023-01-24T21:39:28.207 INFO:tasks.ceph:[global] ms bind msgr2 = False 2023-01-24T21:39:28.208 INFO:tasks.ceph:[global] ms type = async 2023-01-24T21:39:28.208 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-01-24T21:39:28.208 INFO:tasks.ceph:[mgr] debug ms = 1 2023-01-24T21:39:28.208 INFO:tasks.ceph:[mon] debug mon = 20 2023-01-24T21:39:28.209 INFO:tasks.ceph:[mon] debug ms = 1 2023-01-24T21:39:28.209 INFO:tasks.ceph:[mon] debug paxos = 20 2023-01-24T21:39:28.209 INFO:tasks.ceph:[mon] mon scrub interval = 300 2023-01-24T21:39:28.210 INFO:tasks.ceph:[osd] bdev async discard = True 2023-01-24T21:39:28.210 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-01-24T21:39:28.210 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-01-24T21:39:28.210 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-01-24T21:39:28.211 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-01-24T21:39:28.211 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2023-01-24T21:39:28.211 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-01-24T21:39:28.211 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-01-24T21:39:28.212 INFO:tasks.ceph:[osd] debug ms = 1 2023-01-24T21:39:28.212 INFO:tasks.ceph:[osd] debug osd = 20 2023-01-24T21:39:28.212 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-01-24T21:39:28.212 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-01-24T21:39:28.213 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-01-24T21:39:28.213 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-01-24T21:39:28.213 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2023-01-24T21:39:28.213 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2023-01-24T21:39:28.214 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-01-24T21:39:28.214 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2023-01-24T21:39:28.214 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-01-24T21:39:28.214 INFO:tasks.ceph:[osd] osd op queue = debug_random 2023-01-24T21:39:28.215 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2023-01-24T21:39:28.215 INFO:tasks.ceph:Setting up mon.a... 2023-01-24T21:39:28.215 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-01-24T21:39:28.287 INFO:teuthology.orchestra.run.smithi007.stdout:creating /etc/ceph/ceph.keyring 2023-01-24T21:39:28.290 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-01-24T21:39:28.369 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-24T21:39:28.434 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:172.21.15.7:6789]'), ('mon.b', '[v1:172.21.15.7:6790]'), ('mon.c', '[v1:172.21.15.7:6791]')] 2023-01-24T21:39:28.434 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:172.21.15.7:6789],[v1:172.21.15.7:6790],[v1:172.21.15.7:6791]', 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}} 2023-01-24T21:39:28.435 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-24T21:39:28.436 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-01-24T21:39:28.488 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:172.21.15.7:6789]' --addv b '[v1:172.21.15.7:6790]' --addv c '[v1:172.21.15.7:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2023-01-24T21:39:28.570 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-01-24T21:39:28.570 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: generated fsid a59d83ed-89b8-47a3-be21-f6c4b4e37305 2023-01-24T21:39:28.570 INFO:teuthology.orchestra.run.smithi007.stdout:setting min_mon_release = octopus 2023-01-24T21:39:28.571 INFO:teuthology.orchestra.run.smithi007.stdout:epoch 0 2023-01-24T21:39:28.571 INFO:teuthology.orchestra.run.smithi007.stdout:fsid a59d83ed-89b8-47a3-be21-f6c4b4e37305 2023-01-24T21:39:28.571 INFO:teuthology.orchestra.run.smithi007.stdout:last_changed 2023-01-24T21:39:28.570062+0000 2023-01-24T21:39:28.571 INFO:teuthology.orchestra.run.smithi007.stdout:created 2023-01-24T21:39:28.570062+0000 2023-01-24T21:39:28.571 INFO:teuthology.orchestra.run.smithi007.stdout:min_mon_release 15 (octopus) 2023-01-24T21:39:28.572 INFO:teuthology.orchestra.run.smithi007.stdout:election_strategy: 1 2023-01-24T21:39:28.572 INFO:teuthology.orchestra.run.smithi007.stdout:0: v1:172.21.15.7:6789/0 mon.a 2023-01-24T21:39:28.572 INFO:teuthology.orchestra.run.smithi007.stdout:1: v1:172.21.15.7:6790/0 mon.b 2023-01-24T21:39:28.572 INFO:teuthology.orchestra.run.smithi007.stdout:2: v1:172.21.15.7:6791/0 mon.c 2023-01-24T21:39:28.573 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-01-24T21:39:28.574 DEBUG:teuthology.orchestra.run.smithi007:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-01-24T21:39:28.629 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a59d83ed-89b8-47a3-be21-f6c4b4e37305... 2023-01-24T21:39:28.630 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-01-24T21:39:28.712 INFO:teuthology.orchestra.run.smithi007.stdout:[global] 2023-01-24T21:39:28.712 INFO:teuthology.orchestra.run.smithi007.stdout: chdir = "" 2023-01-24T21:39:28.712 INFO:teuthology.orchestra.run.smithi007.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-01-24T21:39:28.713 INFO:teuthology.orchestra.run.smithi007.stdout: auth supported = cephx 2023-01-24T21:39:28.713 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.713 INFO:teuthology.orchestra.run.smithi007.stdout: filestore xattr use omap = true 2023-01-24T21:39:28.713 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.713 INFO:teuthology.orchestra.run.smithi007.stdout: mon clock drift allowed = 1.000 2023-01-24T21:39:28.714 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.714 INFO:teuthology.orchestra.run.smithi007.stdout: osd crush chooseleaf type = 0 2023-01-24T21:39:28.714 INFO:teuthology.orchestra.run.smithi007.stdout: auth debug = true 2023-01-24T21:39:28.714 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.715 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on old message = true 2023-01-24T21:39:28.715 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on bug = true 2023-01-24T21:39:28.715 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.715 INFO:teuthology.orchestra.run.smithi007.stdout: mon max pg per osd = 10000 # >= luminous 2023-01-24T21:39:28.715 INFO:teuthology.orchestra.run.smithi007.stdout: mon pg warn max object skew = 0 2023-01-24T21:39:28.716 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.716 INFO:teuthology.orchestra.run.smithi007.stdout: # disable pg_autoscaler by default for new pools 2023-01-24T21:39:28.716 INFO:teuthology.orchestra.run.smithi007.stdout: osd_pool_default_pg_autoscale_mode = off 2023-01-24T21:39:28.716 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.716 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default size = 2 2023-01-24T21:39:28.717 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.717 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow primary affinity = true 2023-01-24T21:39:28.717 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow pg remap = true 2023-01-24T21:39:28.717 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on legacy crush tunables = false 2023-01-24T21:39:28.717 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on crush straw calc version zero = false 2023-01-24T21:39:28.718 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on no sortbitwise = false 2023-01-24T21:39:28.718 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on osd down out interval zero = false 2023-01-24T21:39:28.718 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on too few osds = false 2023-01-24T21:39:28.718 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-01-24T21:39:28.718 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_no_redundancy = false 2023-01-24T21:39:28.719 INFO:teuthology.orchestra.run.smithi007.stdout: mon_allow_pool_size_one = true 2023-01-24T21:39:28.719 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.719 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-01-24T21:39:28.719 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.720 INFO:teuthology.orchestra.run.smithi007.stdout: osd default data pool replay window = 5 2023-01-24T21:39:28.720 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.720 INFO:teuthology.orchestra.run.smithi007.stdout: mon allow pool delete = true 2023-01-24T21:39:28.720 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.720 INFO:teuthology.orchestra.run.smithi007.stdout: mon cluster log file level = debug 2023-01-24T21:39:28.721 INFO:teuthology.orchestra.run.smithi007.stdout: debug asserts on shutdown = true 2023-01-24T21:39:28.721 INFO:teuthology.orchestra.run.smithi007.stdout: mon health detail to clog = false 2023-01-24T21:39:28.721 INFO:teuthology.orchestra.run.smithi007.stdout: mon host = "[v1:172.21.15.7:6789],[v1:172.21.15.7:6790],[v1:172.21.15.7:6791]" 2023-01-24T21:39:28.721 INFO:teuthology.orchestra.run.smithi007.stdout: mon election default strategy = 1 2023-01-24T21:39:28.721 INFO:teuthology.orchestra.run.smithi007.stdout: ms bind msgr2 = False 2023-01-24T21:39:28.722 INFO:teuthology.orchestra.run.smithi007.stdout: ms type = async 2023-01-24T21:39:28.722 INFO:teuthology.orchestra.run.smithi007.stdout: fsid = a59d83ed-89b8-47a3-be21-f6c4b4e37305 2023-01-24T21:39:28.722 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.722 INFO:teuthology.orchestra.run.smithi007.stdout:[osd] 2023-01-24T21:39:28.723 INFO:teuthology.orchestra.run.smithi007.stdout: osd journal size = 100 2023-01-24T21:39:28.723 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.723 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub load threshold = 5.0 2023-01-24T21:39:28.723 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub max interval = 600 2023-01-24T21:39:28.723 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.724 INFO:teuthology.orchestra.run.smithi007.stdout: osd recover clone overlap = true 2023-01-24T21:39:28.724 INFO:teuthology.orchestra.run.smithi007.stdout: osd recovery max chunk = 1048576 2023-01-24T21:39:28.724 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.724 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug shutdown = true 2023-01-24T21:39:28.724 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug op order = true 2023-01-24T21:39:28.725 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug verify stray on activate = true 2023-01-24T21:39:28.725 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.725 INFO:teuthology.orchestra.run.smithi007.stdout: osd open classes on start = true 2023-01-24T21:39:28.725 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug pg log writeout = true 2023-01-24T21:39:28.726 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.726 INFO:teuthology.orchestra.run.smithi007.stdout: osd deep scrub update digest min age = 30 2023-01-24T21:39:28.726 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.726 INFO:teuthology.orchestra.run.smithi007.stdout: osd map max advance = 10 2023-01-24T21:39:28.726 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.727 INFO:teuthology.orchestra.run.smithi007.stdout: journal zero on create = true 2023-01-24T21:39:28.727 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.727 INFO:teuthology.orchestra.run.smithi007.stdout: filestore ondisk finisher threads = 3 2023-01-24T21:39:28.727 INFO:teuthology.orchestra.run.smithi007.stdout: filestore apply finisher threads = 3 2023-01-24T21:39:28.727 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.728 INFO:teuthology.orchestra.run.smithi007.stdout: bdev debug aio = true 2023-01-24T21:39:28.728 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug misdirected ops = true 2023-01-24T21:39:28.728 INFO:teuthology.orchestra.run.smithi007.stdout: bdev async discard = True 2023-01-24T21:39:28.728 INFO:teuthology.orchestra.run.smithi007.stdout: bdev enable discard = True 2023-01-24T21:39:28.728 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore allocator = bitmap 2023-01-24T21:39:28.729 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore block size = 96636764160 2023-01-24T21:39:28.729 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore fsck on mount = True 2023-01-24T21:39:28.729 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore zero block detection = True 2023-01-24T21:39:28.730 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluefs = 20 2023-01-24T21:39:28.730 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluestore = 20 2023-01-24T21:39:28.731 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2023-01-24T21:39:28.731 INFO:teuthology.orchestra.run.smithi007.stdout: debug osd = 20 2023-01-24T21:39:28.731 INFO:teuthology.orchestra.run.smithi007.stdout: debug rocksdb = 10 2023-01-24T21:39:28.732 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd backfillfull_ratio = 0.85 2023-01-24T21:39:28.732 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd full ratio = 0.9 2023-01-24T21:39:28.733 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd nearfull ratio = 0.8 2023-01-24T21:39:28.733 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug verify cached snaps = True 2023-01-24T21:39:28.733 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug verify missing on start = True 2023-01-24T21:39:28.734 INFO:teuthology.orchestra.run.smithi007.stdout: osd failsafe full ratio = 0.95 2023-01-24T21:39:28.734 INFO:teuthology.orchestra.run.smithi007.stdout: osd mclock override recovery settings = True 2023-01-24T21:39:28.734 INFO:teuthology.orchestra.run.smithi007.stdout: osd objectstore = bluestore 2023-01-24T21:39:28.735 INFO:teuthology.orchestra.run.smithi007.stdout: osd op queue = debug_random 2023-01-24T21:39:28.735 INFO:teuthology.orchestra.run.smithi007.stdout: osd op queue cut off = debug_random 2023-01-24T21:39:28.735 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.735 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr] 2023-01-24T21:39:28.736 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2023-01-24T21:39:28.736 INFO:teuthology.orchestra.run.smithi007.stdout: debug mgr = 20 2023-01-24T21:39:28.737 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2023-01-24T21:39:28.737 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2023-01-24T21:39:28.737 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2023-01-24T21:39:28.738 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2023-01-24T21:39:28.738 INFO:teuthology.orchestra.run.smithi007.stdout: mgr/telemetry/nag = false 2023-01-24T21:39:28.738 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.738 INFO:teuthology.orchestra.run.smithi007.stdout:[mon] 2023-01-24T21:39:28.738 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2023-01-24T21:39:28.739 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2023-01-24T21:39:28.739 INFO:teuthology.orchestra.run.smithi007.stdout: debug paxos = 20 2023-01-24T21:39:28.739 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2023-01-24T21:39:28.739 INFO:teuthology.orchestra.run.smithi007.stdout: mon data avail warn = 5 2023-01-24T21:39:28.740 INFO:teuthology.orchestra.run.smithi007.stdout: mon mgr mkfs grace = 240 2023-01-24T21:39:28.740 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2023-01-24T21:39:28.740 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd reporter subtree level = osd 2023-01-24T21:39:28.740 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd prime pg temp = true 2023-01-24T21:39:28.740 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2023-01-24T21:39:28.741 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.741 INFO:teuthology.orchestra.run.smithi007.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-01-24T21:39:28.741 INFO:teuthology.orchestra.run.smithi007.stdout: auth mon ticket ttl = 660 # 11m 2023-01-24T21:39:28.741 INFO:teuthology.orchestra.run.smithi007.stdout: auth service ticket ttl = 240 # 4m 2023-01-24T21:39:28.741 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.742 INFO:teuthology.orchestra.run.smithi007.stdout: # don't complain about insecure global_id in the test suite 2023-01-24T21:39:28.742 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-01-24T21:39:28.742 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-01-24T21:39:28.742 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.742 INFO:teuthology.orchestra.run.smithi007.stdout: # 1m isn't quite enough 2023-01-24T21:39:28.743 INFO:teuthology.orchestra.run.smithi007.stdout: mon_down_mkfs_grace = 2m 2023-01-24T21:39:28.743 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.743 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_filestore_osds = false 2023-01-24T21:39:28.743 INFO:teuthology.orchestra.run.smithi007.stdout: mon scrub interval = 300 2023-01-24T21:39:28.743 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:28.744 INFO:teuthology.orchestra.run.smithi007.stdout:[client] 2023-01-24T21:39:28.744 INFO:teuthology.orchestra.run.smithi007.stdout: rgw cache enabled = true 2023-01-24T21:39:28.744 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable ops log = true 2023-01-24T21:39:28.744 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable usage log = true 2023-01-24T21:39:28.744 INFO:teuthology.orchestra.run.smithi007.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-01-24T21:39:28.745 INFO:teuthology.orchestra.run.smithi007.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-01-24T21:39:28.745 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.a] 2023-01-24T21:39:28.745 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.b] 2023-01-24T21:39:28.745 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.c] 2023-01-24T21:39:28.746 INFO:tasks.ceph:Creating admin key on mon.a... 2023-01-24T21:39:28.747 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-01-24T21:39:28.839 INFO:tasks.ceph:Copying monmap to all nodes... 2023-01-24T21:39:28.840 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-24T21:39:28.840 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-01-24T21:39:28.855 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-24T21:39:28.855 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-01-24T21:39:28.909 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi007.front.sepia.ceph.com 2023-01-24T21:39:28.910 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-24T21:39:28.910 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.keyring 2023-01-24T21:39:28.910 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-24T21:39:28.984 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-24T21:39:28.984 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-01-24T21:39:29.039 INFO:tasks.ceph:Setting up mon nodes... 2023-01-24T21:39:29.039 INFO:tasks.ceph:Setting up mgr nodes... 2023-01-24T21:39:29.040 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-01-24T21:39:29.126 INFO:teuthology.orchestra.run.smithi007.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-01-24T21:39:29.129 INFO:tasks.ceph:Setting up mds nodes... 2023-01-24T21:39:29.129 INFO:tasks.ceph_client:Setting up client nodes... 2023-01-24T21:39:29.130 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-01-24T21:39:29.168 INFO:teuthology.orchestra.run.smithi007.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-01-24T21:39:29.180 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-01-24T21:39:29.181 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi007.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2023-01-24T21:39:29.181 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-01-24T21:39:29.244 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-01-24T21:39:29.245 INFO:tasks.ceph:role: osd.0 2023-01-24T21:39:29.245 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi007.front.sepia.ceph.com 2023-01-24T21:39:29.245 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-01-24T21:39:29.309 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-01-24T21:39:29.310 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-24T21:39:29.310 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-24T21:39:29.310 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 2023-01-24T21:39:29.310 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-24T21:39:29.311 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2023-01-24T21:39:29.311 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-24T21:39:29.311 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-24T21:39:29.311 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-24T21:39:29.312 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-24T21:39:29.333 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2023-01-24T21:39:29.334 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2023-01-24T21:39:29.335 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-01-24T21:39:29.412 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-01-24T21:39:29.480 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-01-24T21:39:29.546 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-01-24T21:39:29.546 INFO:tasks.ceph:role: osd.1 2023-01-24T21:39:29.547 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi007.front.sepia.ceph.com 2023-01-24T21:39:29.547 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-01-24T21:39:29.611 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-01-24T21:39:29.611 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-24T21:39:29.611 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-24T21:39:29.611 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 2023-01-24T21:39:29.612 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-24T21:39:29.612 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2023-01-24T21:39:29.612 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-24T21:39:29.612 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-24T21:39:29.612 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-24T21:39:29.613 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-24T21:39:29.633 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2023-01-24T21:39:29.635 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2023-01-24T21:39:29.635 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-01-24T21:39:29.712 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-01-24T21:39:29.780 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-01-24T21:39:29.845 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-01-24T21:39:29.845 INFO:tasks.ceph:role: osd.2 2023-01-24T21:39:29.846 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi007.front.sepia.ceph.com 2023-01-24T21:39:29.846 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-01-24T21:39:29.909 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-01-24T21:39:29.909 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-24T21:39:29.909 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-24T21:39:29.909 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 2023-01-24T21:39:29.910 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-24T21:39:29.910 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2023-01-24T21:39:29.910 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-24T21:39:29.910 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-24T21:39:29.910 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-24T21:39:29.911 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-24T21:39:29.931 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2023-01-24T21:39:29.933 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2023-01-24T21:39:29.933 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-01-24T21:39:30.010 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-01-24T21:39:30.078 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-24T21:39:30.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-24T21:39:30.159+0000 7fc05f0d9540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-01-24T21:39:30.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-24T21:39:30.159+0000 7fc05f0d9540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-01-24T21:39:30.161 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-24T21:39:30.159+0000 7fc05f0d9540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-24T21:39:30.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-24T21:39:30.159+0000 7fc05f0d9540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-24T21:39:30.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-24T21:39:30.159+0000 7fc05f0d9540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-24T21:39:30.162 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-24T21:39:30.160+0000 7fc05f0d9540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-01-24T21:39:33.012 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-01-24T21:39:33.083 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-24T21:39:33.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-24T21:39:33.170+0000 7f1f51f8b540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-01-24T21:39:33.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-24T21:39:33.170+0000 7f1f51f8b540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-01-24T21:39:33.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-24T21:39:33.170+0000 7f1f51f8b540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-24T21:39:33.172 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-24T21:39:33.170+0000 7f1f51f8b540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-24T21:39:33.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-24T21:39:33.170+0000 7f1f51f8b540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-24T21:39:33.173 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-24T21:39:33.170+0000 7f1f51f8b540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-01-24T21:39:36.041 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-01-24T21:39:36.070 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-24T21:39:36.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-24T21:39:36.155+0000 7fafda4bb540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-01-24T21:39:36.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-24T21:39:36.155+0000 7fafda4bb540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-01-24T21:39:36.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-24T21:39:36.155+0000 7fafda4bb540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-24T21:39:36.157 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-24T21:39:36.155+0000 7fafda4bb540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-24T21:39:36.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-24T21:39:36.155+0000 7fafda4bb540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-24T21:39:36.158 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-24T21:39:36.155+0000 7fafda4bb540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-01-24T21:39:39.012 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-01-24T21:39:39.042 INFO:tasks.ceph:Reading keys from all nodes... 2023-01-24T21:39:39.042 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-24T21:39:39.043 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-01-24T21:39:39.110 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-24T21:39:39.111 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-01-24T21:39:39.177 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-24T21:39:39.177 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-01-24T21:39:39.243 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-24T21:39:39.243 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-01-24T21:39:39.310 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-24T21:39:39.311 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-01-24T21:39:39.366 INFO:tasks.ceph:Adding keys to all mons... 2023-01-24T21:39:39.366 DEBUG:teuthology.orchestra.run.smithi007:> sudo tee -a /etc/ceph/ceph.keyring 2023-01-24T21:39:39.431 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr.x] 2023-01-24T21:39:39.431 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQARUNBjQ8SQBxAAIvAEYI3aaEgbao6Ypz5hMw== 2023-01-24T21:39:39.431 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.0] 2023-01-24T21:39:39.432 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQASUNBj/KaVCRAA2DKveAyFnNbyHQ4MZSVNbQ== 2023-01-24T21:39:39.432 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.1] 2023-01-24T21:39:39.432 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAVUNBjRGY5ChAA/xWqpbcFXT4DdFyquxEtGw== 2023-01-24T21:39:39.432 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.2] 2023-01-24T21:39:39.432 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAYUNBjpQ1TCRAABPxEfAFQYfJ3YipEDkwIgg== 2023-01-24T21:39:39.433 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2023-01-24T21:39:39.433 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQARUNBjvhAFChAAUN6tOmTKKqwA5MfkTBswDg== 2023-01-24T21:39:39.434 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-24T21:39:39.524 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-24T21:39:39.575 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-24T21:39:39.622 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-24T21:39:39.669 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-24T21:39:39.719 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-01-24T21:39:39.720 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-01-24T21:39:39.744 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-24T21:39:39.836 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-01-24T21:39:39.860 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-01-24T21:39:39.924 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-24T21:39:40.015 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-01-24T21:39:40.040 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-01-24T21:39:40.104 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-24T21:39:40.195 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-01-24T21:39:40.219 DEBUG:teuthology.orchestra.run.smithi007:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-01-24T21:39:40.273 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-01-24T21:39:40.273 INFO:tasks.ceph.mon.a:Restarting daemon 2023-01-24T21:39:40.274 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-01-24T21:39:40.315 INFO:tasks.ceph.mon.a:Started 2023-01-24T21:39:40.316 INFO:tasks.ceph.mon.b:Restarting daemon 2023-01-24T21:39:40.316 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-01-24T21:39:40.318 INFO:tasks.ceph.mon.b:Started 2023-01-24T21:39:40.319 INFO:tasks.ceph.mon.c:Restarting daemon 2023-01-24T21:39:40.319 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-01-24T21:39:40.321 INFO:tasks.ceph.mon.c:Started 2023-01-24T21:39:40.321 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-01-24T21:39:40.322 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-01-24T21:39:40.322 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-01-24T21:39:40.324 INFO:tasks.ceph.mgr.x:Started 2023-01-24T21:39:40.325 INFO:tasks.ceph:Setting crush tunables to default 2023-01-24T21:39:40.325 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph osd crush tunables default 2023-01-24T21:39:45.581 INFO:teuthology.orchestra.run.smithi007.stderr:adjusted tunables profile to default 2023-01-24T21:39:45.593 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-01-24T21:39:45.594 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-24T21:39:45.594 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-01-24T21:39:45.619 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-24T21:39:45.620 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-01-24T21:39:45.683 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-24T21:39:45.684 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-01-24T21:39:45.747 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph osd new 6d40d965-9a66-46d2-8758-d2034c9feb28 0 2023-01-24T21:39:45.996 INFO:teuthology.orchestra.run.smithi007.stdout:0 2023-01-24T21:39:46.008 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph osd new 0fa19857-21e0-4c68-b4f7-58da09ad64fa 1 2023-01-24T21:39:46.221 INFO:teuthology.orchestra.run.smithi007.stdout:1 2023-01-24T21:39:46.234 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph osd new a94607f3-c9bd-4b4d-8fb2-b1d8a06892c5 2 2023-01-24T21:39:46.461 INFO:teuthology.orchestra.run.smithi007.stdout:2 2023-01-24T21:39:46.473 INFO:tasks.ceph.osd.0:Restarting daemon 2023-01-24T21:39:46.474 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-01-24T21:39:46.476 INFO:tasks.ceph.osd.0:Started 2023-01-24T21:39:46.476 INFO:tasks.ceph.osd.1:Restarting daemon 2023-01-24T21:39:46.476 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-01-24T21:39:46.484 INFO:tasks.ceph.osd.1:Started 2023-01-24T21:39:46.484 INFO:tasks.ceph.osd.2:Restarting daemon 2023-01-24T21:39:46.484 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-01-24T21:39:46.486 INFO:tasks.ceph.osd.2:Started 2023-01-24T21:39:46.487 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-24T21:39:46.716 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:46.716 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":5,"fsid":"a59d83ed-89b8-47a3-be21-f6c4b4e37305","created":"2023-01-24T21:39:45.471377+0000","modified":"2023-01-24T21:39:46.459030+0000","last_up_change":"0.000000","last_in_change":"2023-01-24T21:39:46.459030+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"6d40d965-9a66-46d2-8758-d2034c9feb28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0fa19857-21e0-4c68-b4f7-58da09ad64fa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a94607f3-c9bd-4b4d-8fb2-b1d8a06892c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-24T21:39:46.729 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-01-24T21:39:46.729 INFO:tasks.ceph:Waiting for OSDs to come up 2023-01-24T21:39:46.752 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:46.751+0000 7f0c6ba23180 -1 mgr[py] Module not found: 'prometheus' 2023-01-24T21:39:46.752 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:46.751+0000 7f0c6ba23180 -1 mgr[py] Traceback (most recent call last): 2023-01-24T21:39:46.753 INFO:tasks.ceph.mgr.x.smithi007.stderr: File "/usr/share/ceph/mgr/prometheus/__init__.py", line 2, in 2023-01-24T21:39:46.753 INFO:tasks.ceph.mgr.x.smithi007.stderr: from .module import Module, StandbyModule 2023-01-24T21:39:46.753 INFO:tasks.ceph.mgr.x.smithi007.stderr: File "/usr/share/ceph/mgr/prometheus/module.py", line 3, in 2023-01-24T21:39:46.753 INFO:tasks.ceph.mgr.x.smithi007.stderr: from packaging.version import Version 2023-01-24T21:39:46.753 INFO:tasks.ceph.mgr.x.smithi007.stderr:ModuleNotFoundError: No module named 'packaging' 2023-01-24T21:39:46.754 INFO:tasks.ceph.mgr.x.smithi007.stderr: 2023-01-24T21:39:46.754 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:46.751+0000 7f0c6ba23180 -1 mgr[py] Class not found in module 'prometheus' 2023-01-24T21:39:46.754 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:46.751+0000 7f0c6ba23180 -1 mgr[py] Error loading module 'prometheus': (2) No such file or directory 2023-01-24T21:39:46.889 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:46.888+0000 7f0c6ba23180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-01-24T21:39:46.967 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:46.966+0000 7f0c6ba23180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-01-24T21:39:47.031 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-01-24T21:39:47.080 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-24T21:39:47.078+0000 7f3d9dfc4540 -1 Falling back to public interface 2023-01-24T21:39:47.080 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-24T21:39:47.079+0000 7f3d983ec700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6800/0: (98) Address already in use 2023-01-24T21:39:47.081 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-24T21:39:47.079+0000 7f5c0ddce540 -1 Falling back to public interface 2023-01-24T21:39:47.081 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-24T21:39:47.078+0000 7f01e5295540 -1 Falling back to public interface 2023-01-24T21:39:47.082 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-24T21:39:47.079+0000 7f01df6bd700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6800/0: (98) Address already in use 2023-01-24T21:39:47.082 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-24T21:39:47.079+0000 7f3d983ec700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6801/0: (98) Address already in use 2023-01-24T21:39:47.163 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:47.162+0000 7f0c6ba23180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-01-24T21:39:47.218 INFO:teuthology.misc.health.smithi007.stdout: 2023-01-24T21:39:47.218 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":5,"fsid":"a59d83ed-89b8-47a3-be21-f6c4b4e37305","created":"2023-01-24T21:39:45.471377+0000","modified":"2023-01-24T21:39:46.459030+0000","last_up_change":"0.000000","last_in_change":"2023-01-24T21:39:46.459030+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"6d40d965-9a66-46d2-8758-d2034c9feb28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0fa19857-21e0-4c68-b4f7-58da09ad64fa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a94607f3-c9bd-4b4d-8fb2-b1d8a06892c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-24T21:39:47.229 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-01-24T21:39:47.342 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:47.341+0000 7f0c6ba23180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-01-24T21:39:47.421 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:47.420+0000 7f0c6ba23180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-01-24T21:39:47.561 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:47.560+0000 7f0c6ba23180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-01-24T21:39:47.659 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:47.658+0000 7f0c6ba23180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-01-24T21:39:48.185 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:48.184+0000 7f0c6ba23180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-01-24T21:39:48.265 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:48.264+0000 7f0c6ba23180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-01-24T21:39:48.345 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:48.343+0000 7f0c6ba23180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-01-24T21:39:48.950 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:48.948+0000 7f0c6ba23180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-01-24T21:39:49.091 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:49.090+0000 7f0c6ba23180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-01-24T21:39:49.180 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:49.179+0000 7f0c6ba23180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-01-24T21:39:49.434 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:49.433+0000 7f0c6ba23180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-01-24T21:39:49.514 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:49.513+0000 7f0c6ba23180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-01-24T21:39:50.162 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:50.161+0000 7f0c6ba23180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-01-24T21:39:50.417 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:50.416+0000 7f0c6ba23180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-01-24T21:39:50.555 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:50.553+0000 7f0c6ba23180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-01-24T21:39:50.596 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-24T21:39:50.595+0000 7f01e5295540 -1 osd.2 0 log_to_monitors true 2023-01-24T21:39:50.616 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-24T21:39:50.615+0000 7f5c0ddce540 -1 osd.1 0 log_to_monitors true 2023-01-24T21:39:50.622 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-24T21:39:50.621+0000 7f3d9dfc4540 -1 osd.0 0 log_to_monitors true 2023-01-24T21:39:50.655 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:50.654+0000 7f0c6ba23180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-01-24T21:39:50.811 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:50.810+0000 7f0c6ba23180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-01-24T21:39:50.889 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:50.888+0000 7f0c6ba23180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-01-24T21:39:50.966 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:50.965+0000 7f0c6ba23180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-01-24T21:39:51.047 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:51.046+0000 7f0c6ba23180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-01-24T21:39:51.047 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:51.046+0000 7f0c6ba23180 -1 log_channel(cluster) log [ERR] : Failed to load ceph-mgr modules: prometheus 2023-01-24T21:39:52.070 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:52.068+0000 7f0c24ef0700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-01-24T21:39:52.070 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:39:52.069+0000 7f0c24ef0700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-01-24T21:39:52.440 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-24T21:39:52.438+0000 7f5c049ef700 -1 osd.1 0 waiting for initial osdmap 2023-01-24T21:39:52.440 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-24T21:39:52.438+0000 7f3d94be5700 -1 osd.0 0 waiting for initial osdmap 2023-01-24T21:39:52.442 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-24T21:39:52.441+0000 7f01dbeb6700 -1 osd.2 0 waiting for initial osdmap 2023-01-24T21:39:52.445 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-24T21:39:52.444+0000 7f3d8d9db700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-24T21:39:52.446 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-24T21:39:52.445+0000 7f5bfd7e5700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-24T21:39:52.447 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-24T21:39:52.446+0000 7f01d4cac700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-24T21:39:53.531 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-01-24T21:39:53.857 INFO:teuthology.misc.health.smithi007.stdout: 2023-01-24T21:39:53.858 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":8,"fsid":"a59d83ed-89b8-47a3-be21-f6c4b4e37305","created":"2023-01-24T21:39:45.471377+0000","modified":"2023-01-24T21:39:53.438305+0000","last_up_change":"2023-01-24T21:39:53.438305+0000","last_in_change":"2023-01-24T21:39:46.459030+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"6d40d965-9a66-46d2-8758-d2034c9feb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6802","nonce":81207}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6805","nonce":81207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6810","nonce":81207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6807","nonce":81207}]},"public_addr":"172.21.15.7:6802/81207","cluster_addr":"172.21.15.7:6805/81207","heartbeat_back_addr":"172.21.15.7:6810/81207","heartbeat_front_addr":"172.21.15.7:6807/81207","state":["exists","up"]},{"osd":1,"uuid":"0fa19857-21e0-4c68-b4f7-58da09ad64fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6800","nonce":81208}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6803","nonce":81208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6809","nonce":81208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6806","nonce":81208}]},"public_addr":"172.21.15.7:6800/81208","cluster_addr":"172.21.15.7:6803/81208","heartbeat_back_addr":"172.21.15.7:6809/81208","heartbeat_front_addr":"172.21.15.7:6806/81208","state":["exists","up"]},{"osd":2,"uuid":"a94607f3-c9bd-4b4d-8fb2-b1d8a06892c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6801","nonce":81209}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6804","nonce":81209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6811","nonce":81209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6808","nonce":81209}]},"public_addr":"172.21.15.7:6801/81209","cluster_addr":"172.21.15.7:6804/81209","heartbeat_back_addr":"172.21.15.7:6811/81209","heartbeat_front_addr":"172.21.15.7:6808/81209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-24T21:39:53.871 DEBUG:teuthology.misc:3 of 3 OSDs are up 2023-01-24T21:39:53.872 INFO:tasks.ceph:Creating RBD pool 2023-01-24T21:39:53.873 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph osd pool create rbd 8 2023-01-24T21:39:54.454 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'rbd' created 2023-01-24T21:39:54.466 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-01-24T21:39:55.462 INFO:teuthology.orchestra.run.smithi007.stderr:enabled application 'rbd' on pool 'rbd' 2023-01-24T21:39:55.474 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-01-24T21:39:55.475 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-01-24T21:39:55.475 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-01-24T21:39:55.476 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-01-24T21:39:55.476 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-01-24T21:39:55.847 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:55.860 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":4,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6812","nonce":80782}]},"active_addr":"172.21.15.7:6812/80782","active_change":"2023-01-24T21:39:51.059919+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":false,"error_string":"No module named 'packaging'","module_options":{}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":789663481}]},{"addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":4206946925}]},{"addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":2875639386}]}]}} 2023-01-24T21:39:55.864 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-01-24T21:39:55.864 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-01-24T21:39:55.865 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-24T21:39:56.179 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:56.179 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":10,"fsid":"a59d83ed-89b8-47a3-be21-f6c4b4e37305","created":"2023-01-24T21:39:45.471377+0000","modified":"2023-01-24T21:39:55.447612+0000","last_up_change":"2023-01-24T21:39:53.438305+0000","last_in_change":"2023-01-24T21:39:46.459030+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-01-24T21:39:54.220837+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-01-24T21:39:55.107850+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"6d40d965-9a66-46d2-8758-d2034c9feb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6802","nonce":81207}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6805","nonce":81207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6810","nonce":81207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6807","nonce":81207}]},"public_addr":"172.21.15.7:6802/81207","cluster_addr":"172.21.15.7:6805/81207","heartbeat_back_addr":"172.21.15.7:6810/81207","heartbeat_front_addr":"172.21.15.7:6807/81207","state":["exists","up"]},{"osd":1,"uuid":"0fa19857-21e0-4c68-b4f7-58da09ad64fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6800","nonce":81208}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6803","nonce":81208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6809","nonce":81208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6806","nonce":81208}]},"public_addr":"172.21.15.7:6800/81208","cluster_addr":"172.21.15.7:6803/81208","heartbeat_back_addr":"172.21.15.7:6809/81208","heartbeat_front_addr":"172.21.15.7:6806/81208","state":["exists","up"]},{"osd":2,"uuid":"a94607f3-c9bd-4b4d-8fb2-b1d8a06892c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6801","nonce":81209}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6804","nonce":81209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6811","nonce":81209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6808","nonce":81209}]},"public_addr":"172.21.15.7:6801/81209","cluster_addr":"172.21.15.7:6804/81209","heartbeat_back_addr":"172.21.15.7:6811/81209","heartbeat_front_addr":"172.21.15.7:6808/81209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T21:39:51.635568+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T21:39:51.591221+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T21:39:51.635232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-24T21:39:56.192 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-01-24T21:39:56.193 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-24T21:39:56.514 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:56.514 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":11,"fsid":"a59d83ed-89b8-47a3-be21-f6c4b4e37305","created":"2023-01-24T21:39:45.471377+0000","modified":"2023-01-24T21:39:56.450673+0000","last_up_change":"2023-01-24T21:39:53.438305+0000","last_in_change":"2023-01-24T21:39:46.459030+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-01-24T21:39:54.220837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-01-24T21:39:55.107850+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"6d40d965-9a66-46d2-8758-d2034c9feb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6802","nonce":81207}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6805","nonce":81207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6810","nonce":81207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6807","nonce":81207}]},"public_addr":"172.21.15.7:6802/81207","cluster_addr":"172.21.15.7:6805/81207","heartbeat_back_addr":"172.21.15.7:6810/81207","heartbeat_front_addr":"172.21.15.7:6807/81207","state":["exists","up"]},{"osd":1,"uuid":"0fa19857-21e0-4c68-b4f7-58da09ad64fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6800","nonce":81208}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6803","nonce":81208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6809","nonce":81208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6806","nonce":81208}]},"public_addr":"172.21.15.7:6800/81208","cluster_addr":"172.21.15.7:6803/81208","heartbeat_back_addr":"172.21.15.7:6809/81208","heartbeat_front_addr":"172.21.15.7:6806/81208","state":["exists","up"]},{"osd":2,"uuid":"a94607f3-c9bd-4b4d-8fb2-b1d8a06892c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6801","nonce":81209}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6804","nonce":81209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6811","nonce":81209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.7:6808","nonce":81209}]},"public_addr":"172.21.15.7:6801/81209","cluster_addr":"172.21.15.7:6804/81209","heartbeat_back_addr":"172.21.15.7:6811/81209","heartbeat_front_addr":"172.21.15.7:6808/81209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T21:39:51.635568+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T21:39:51.591221+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T21:39:51.635232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-24T21:39:56.531 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-01-24T21:39:56.532 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-01-24T21:39:56.533 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-01-24T21:39:56.712 INFO:teuthology.orchestra.run.smithi007.stdout:34359738371 2023-01-24T21:39:56.713 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-01-24T21:39:56.714 INFO:teuthology.orchestra.run.smithi007.stdout:34359738370 2023-01-24T21:39:56.715 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-01-24T21:39:56.738 INFO:teuthology.orchestra.run.smithi007.stdout:34359738370 2023-01-24T21:39:56.739 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-01-24T21:39:57.063 INFO:teuthology.orchestra.run.smithi007.stdout:34359738369 2023-01-24T21:39:57.078 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738370 got 34359738369 for osd.1 2023-01-24T21:39:57.122 INFO:teuthology.orchestra.run.smithi007.stdout:34359738370 2023-01-24T21:39:57.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738370 for osd.2 2023-01-24T21:39:57.215 INFO:teuthology.orchestra.run.smithi007.stdout:34359738369 2023-01-24T21:39:57.232 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738370 got 34359738369 for osd.0 2023-01-24T21:39:58.079 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-01-24T21:39:58.137 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-01-24T21:39:58.233 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-01-24T21:39:58.415 INFO:teuthology.orchestra.run.smithi007.stdout:34359738370 2023-01-24T21:39:58.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738370 got 34359738370 for osd.1 2023-01-24T21:39:58.430 DEBUG:teuthology.parallel:result is None 2023-01-24T21:39:58.472 INFO:teuthology.orchestra.run.smithi007.stdout:34359738371 2023-01-24T21:39:58.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738371 for osd.2 2023-01-24T21:39:58.486 DEBUG:teuthology.parallel:result is None 2023-01-24T21:39:58.560 INFO:teuthology.orchestra.run.smithi007.stdout:34359738370 2023-01-24T21:39:58.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738370 got 34359738370 for osd.0 2023-01-24T21:39:58.574 DEBUG:teuthology.parallel:result is None 2023-01-24T21:39:58.574 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-01-24T21:39:58.575 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-24T21:39:58.887 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:58.889 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-01-24T21:39:58.900 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2023-01-24T21:39:57.459069+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":99,"num_write_kb":1110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":15088,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":14784,"kb_avail":283100432,"statfs":{"total":289910292480,"available":289894842368,"internally_reserved":0,"allocated":286720,"data_stored":66896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15138816},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.394717"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-01-24T21:39:55.461371+0000","last_change":"2023-01-24T21:39:55.460160+0000","last_active":"2023-01-24T21:39:55.461371+0000","last_peered":"2023-01-24T21:39:55.461371+0000","last_clean":"2023-01-24T21:39:55.461371+0000","last_became_active":"2023-01-24T21:39:55.459914+0000","last_became_peered":"2023-01-24T21:39:55.459914+0000","last_unstale":"2023-01-24T21:39:55.461371+0000","last_undegraded":"2023-01-24T21:39:55.461371+0000","last_fullsized":"2023-01-24T21:39:55.461371+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_clean_scrub_stamp":"2023-01-24T21:39:54.444353+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T22:31:52.170453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-01-24T21:39:55.458194+0000","last_change":"2023-01-24T21:39:55.456301+0000","last_active":"2023-01-24T21:39:55.458194+0000","last_peered":"2023-01-24T21:39:55.458194+0000","last_clean":"2023-01-24T21:39:55.458194+0000","last_became_active":"2023-01-24T21:39:55.455786+0000","last_became_peered":"2023-01-24T21:39:55.455786+0000","last_unstale":"2023-01-24T21:39:55.458194+0000","last_undegraded":"2023-01-24T21:39:55.458194+0000","last_fullsized":"2023-01-24T21:39:55.458194+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_clean_scrub_stamp":"2023-01-24T21:39:54.444353+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T07:28:02.328042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-01-24T21:39:55.460871+0000","last_change":"2023-01-24T21:39:55.460163+0000","last_active":"2023-01-24T21:39:55.460871+0000","last_peered":"2023-01-24T21:39:55.460871+0000","last_clean":"2023-01-24T21:39:55.460871+0000","last_became_active":"2023-01-24T21:39:55.459884+0000","last_became_peered":"2023-01-24T21:39:55.459884+0000","last_unstale":"2023-01-24T21:39:55.460871+0000","last_undegraded":"2023-01-24T21:39:55.460871+0000","last_fullsized":"2023-01-24T21:39:55.460871+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_clean_scrub_stamp":"2023-01-24T21:39:54.444353+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T22:53:13.460426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-01-24T21:39:55.459197+0000","last_change":"2023-01-24T21:39:55.457028+0000","last_active":"2023-01-24T21:39:55.459197+0000","last_peered":"2023-01-24T21:39:55.459197+0000","last_clean":"2023-01-24T21:39:55.459197+0000","last_became_active":"2023-01-24T21:39:55.456720+0000","last_became_peered":"2023-01-24T21:39:55.456720+0000","last_unstale":"2023-01-24T21:39:55.459197+0000","last_undegraded":"2023-01-24T21:39:55.459197+0000","last_fullsized":"2023-01-24T21:39:55.459197+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_clean_scrub_stamp":"2023-01-24T21:39:54.444353+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T02:17:09.155039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-01-24T21:39:55.458925+0000","last_change":"2023-01-24T21:39:55.457395+0000","last_active":"2023-01-24T21:39:55.458925+0000","last_peered":"2023-01-24T21:39:55.458925+0000","last_clean":"2023-01-24T21:39:55.458925+0000","last_became_active":"2023-01-24T21:39:55.457162+0000","last_became_peered":"2023-01-24T21:39:55.457162+0000","last_unstale":"2023-01-24T21:39:55.458925+0000","last_undegraded":"2023-01-24T21:39:55.458925+0000","last_fullsized":"2023-01-24T21:39:55.458925+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_clean_scrub_stamp":"2023-01-24T21:39:54.444353+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T05:35:20.546509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"11'64","reported_seq":96,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-01-24T21:39:56.578187+0000","last_change":"2023-01-24T21:39:56.500335+0000","last_active":"2023-01-24T21:39:56.578187+0000","last_peered":"2023-01-24T21:39:56.578187+0000","last_clean":"2023-01-24T21:39:56.578187+0000","last_became_active":"2023-01-24T21:39:56.499595+0000","last_became_peered":"2023-01-24T21:39:56.499595+0000","last_unstale":"2023-01-24T21:39:56.578187+0000","last_undegraded":"2023-01-24T21:39:56.578187+0000","last_fullsized":"2023-01-24T21:39:56.578187+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T21:39:55.447612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T21:39:55.447612+0000","last_clean_scrub_stamp":"2023-01-24T21:39:55.447612+0000","objects_scrubbed":0,"log_size":64,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T07:28:03.331300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":99,"num_write_kb":1110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-01-24T21:39:55.460801+0000","last_change":"2023-01-24T21:39:55.459665+0000","last_active":"2023-01-24T21:39:55.460801+0000","last_peered":"2023-01-24T21:39:55.460801+0000","last_clean":"2023-01-24T21:39:55.460801+0000","last_became_active":"2023-01-24T21:39:55.459394+0000","last_became_peered":"2023-01-24T21:39:55.459394+0000","last_unstale":"2023-01-24T21:39:55.460801+0000","last_undegraded":"2023-01-24T21:39:55.460801+0000","last_fullsized":"2023-01-24T21:39:55.460801+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_clean_scrub_stamp":"2023-01-24T21:39:54.444353+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T02:01:21.924187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-01-24T21:39:55.460364+0000","last_change":"2023-01-24T21:39:55.458239+0000","last_active":"2023-01-24T21:39:55.460364+0000","last_peered":"2023-01-24T21:39:55.460364+0000","last_clean":"2023-01-24T21:39:55.460364+0000","last_became_active":"2023-01-24T21:39:55.457969+0000","last_became_peered":"2023-01-24T21:39:55.457969+0000","last_unstale":"2023-01-24T21:39:55.460364+0000","last_undegraded":"2023-01-24T21:39:55.460364+0000","last_fullsized":"2023-01-24T21:39:55.460364+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_clean_scrub_stamp":"2023-01-24T21:39:54.444353+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T05:04:42.428315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-01-24T21:39:55.462146+0000","last_change":"2023-01-24T21:39:55.461218+0000","last_active":"2023-01-24T21:39:55.462146+0000","last_peered":"2023-01-24T21:39:55.462146+0000","last_clean":"2023-01-24T21:39:55.462146+0000","last_became_active":"2023-01-24T21:39:55.460961+0000","last_became_peered":"2023-01-24T21:39:55.460961+0000","last_unstale":"2023-01-24T21:39:55.462146+0000","last_undegraded":"2023-01-24T21:39:55.462146+0000","last_fullsized":"2023-01-24T21:39:55.462146+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_clean_scrub_stamp":"2023-01-24T21:39:54.444353+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T01:39:36.790147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":99,"num_write_kb":1110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5032,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366808,"statfs":{"total":96636764160,"available":96631611392,"internally_reserved":0,"allocated":98304,"data_stored":23440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23200000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738370,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5032,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366808,"statfs":{"total":96636764160,"available":96631611392,"internally_reserved":0,"allocated":98304,"data_stored":23440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.188}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738370,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5024,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366816,"statfs":{"total":96636764160,"available":96631619584,"internally_reserved":0,"allocated":90112,"data_stored":20016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-24T21:39:58.902 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-24T21:39:59.211 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:59.213 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-01-24T21:39:59.224 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2023-01-24T21:39:59.064642+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":99,"num_write_kb":1110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":15088,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":14784,"kb_avail":283100432,"statfs":{"total":289910292480,"available":289894842368,"internally_reserved":0,"allocated":286720,"data_stored":66896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15138816},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000290"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-01-24T21:39:55.461371+0000","last_change":"2023-01-24T21:39:55.460160+0000","last_active":"2023-01-24T21:39:55.461371+0000","last_peered":"2023-01-24T21:39:55.461371+0000","last_clean":"2023-01-24T21:39:55.461371+0000","last_became_active":"2023-01-24T21:39:55.459914+0000","last_became_peered":"2023-01-24T21:39:55.459914+0000","last_unstale":"2023-01-24T21:39:55.461371+0000","last_undegraded":"2023-01-24T21:39:55.461371+0000","last_fullsized":"2023-01-24T21:39:55.461371+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_clean_scrub_stamp":"2023-01-24T21:39:54.444353+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T22:31:52.170453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-01-24T21:39:55.458194+0000","last_change":"2023-01-24T21:39:55.456301+0000","last_active":"2023-01-24T21:39:55.458194+0000","last_peered":"2023-01-24T21:39:55.458194+0000","last_clean":"2023-01-24T21:39:55.458194+0000","last_became_active":"2023-01-24T21:39:55.455786+0000","last_became_peered":"2023-01-24T21:39:55.455786+0000","last_unstale":"2023-01-24T21:39:55.458194+0000","last_undegraded":"2023-01-24T21:39:55.458194+0000","last_fullsized":"2023-01-24T21:39:55.458194+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_clean_scrub_stamp":"2023-01-24T21:39:54.444353+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T07:28:02.328042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-01-24T21:39:55.460871+0000","last_change":"2023-01-24T21:39:55.460163+0000","last_active":"2023-01-24T21:39:55.460871+0000","last_peered":"2023-01-24T21:39:55.460871+0000","last_clean":"2023-01-24T21:39:55.460871+0000","last_became_active":"2023-01-24T21:39:55.459884+0000","last_became_peered":"2023-01-24T21:39:55.459884+0000","last_unstale":"2023-01-24T21:39:55.460871+0000","last_undegraded":"2023-01-24T21:39:55.460871+0000","last_fullsized":"2023-01-24T21:39:55.460871+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_clean_scrub_stamp":"2023-01-24T21:39:54.444353+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T22:53:13.460426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-01-24T21:39:55.459197+0000","last_change":"2023-01-24T21:39:55.457028+0000","last_active":"2023-01-24T21:39:55.459197+0000","last_peered":"2023-01-24T21:39:55.459197+0000","last_clean":"2023-01-24T21:39:55.459197+0000","last_became_active":"2023-01-24T21:39:55.456720+0000","last_became_peered":"2023-01-24T21:39:55.456720+0000","last_unstale":"2023-01-24T21:39:55.459197+0000","last_undegraded":"2023-01-24T21:39:55.459197+0000","last_fullsized":"2023-01-24T21:39:55.459197+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_clean_scrub_stamp":"2023-01-24T21:39:54.444353+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T02:17:09.155039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-01-24T21:39:55.458925+0000","last_change":"2023-01-24T21:39:55.457395+0000","last_active":"2023-01-24T21:39:55.458925+0000","last_peered":"2023-01-24T21:39:55.458925+0000","last_clean":"2023-01-24T21:39:55.458925+0000","last_became_active":"2023-01-24T21:39:55.457162+0000","last_became_peered":"2023-01-24T21:39:55.457162+0000","last_unstale":"2023-01-24T21:39:55.458925+0000","last_undegraded":"2023-01-24T21:39:55.458925+0000","last_fullsized":"2023-01-24T21:39:55.458925+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_clean_scrub_stamp":"2023-01-24T21:39:54.444353+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T05:35:20.546509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"11'64","reported_seq":96,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-01-24T21:39:56.578187+0000","last_change":"2023-01-24T21:39:56.500335+0000","last_active":"2023-01-24T21:39:56.578187+0000","last_peered":"2023-01-24T21:39:56.578187+0000","last_clean":"2023-01-24T21:39:56.578187+0000","last_became_active":"2023-01-24T21:39:56.499595+0000","last_became_peered":"2023-01-24T21:39:56.499595+0000","last_unstale":"2023-01-24T21:39:56.578187+0000","last_undegraded":"2023-01-24T21:39:56.578187+0000","last_fullsized":"2023-01-24T21:39:56.578187+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T21:39:55.447612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T21:39:55.447612+0000","last_clean_scrub_stamp":"2023-01-24T21:39:55.447612+0000","objects_scrubbed":0,"log_size":64,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T07:28:03.331300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":99,"num_write_kb":1110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-01-24T21:39:55.460801+0000","last_change":"2023-01-24T21:39:55.459665+0000","last_active":"2023-01-24T21:39:55.460801+0000","last_peered":"2023-01-24T21:39:55.460801+0000","last_clean":"2023-01-24T21:39:55.460801+0000","last_became_active":"2023-01-24T21:39:55.459394+0000","last_became_peered":"2023-01-24T21:39:55.459394+0000","last_unstale":"2023-01-24T21:39:55.460801+0000","last_undegraded":"2023-01-24T21:39:55.460801+0000","last_fullsized":"2023-01-24T21:39:55.460801+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_clean_scrub_stamp":"2023-01-24T21:39:54.444353+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T02:01:21.924187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-01-24T21:39:55.460364+0000","last_change":"2023-01-24T21:39:55.458239+0000","last_active":"2023-01-24T21:39:55.460364+0000","last_peered":"2023-01-24T21:39:55.460364+0000","last_clean":"2023-01-24T21:39:55.460364+0000","last_became_active":"2023-01-24T21:39:55.457969+0000","last_became_peered":"2023-01-24T21:39:55.457969+0000","last_unstale":"2023-01-24T21:39:55.460364+0000","last_undegraded":"2023-01-24T21:39:55.460364+0000","last_fullsized":"2023-01-24T21:39:55.460364+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_clean_scrub_stamp":"2023-01-24T21:39:54.444353+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T05:04:42.428315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-01-24T21:39:55.462146+0000","last_change":"2023-01-24T21:39:55.461218+0000","last_active":"2023-01-24T21:39:55.462146+0000","last_peered":"2023-01-24T21:39:55.462146+0000","last_clean":"2023-01-24T21:39:55.462146+0000","last_became_active":"2023-01-24T21:39:55.460961+0000","last_became_peered":"2023-01-24T21:39:55.460961+0000","last_unstale":"2023-01-24T21:39:55.462146+0000","last_undegraded":"2023-01-24T21:39:55.462146+0000","last_fullsized":"2023-01-24T21:39:55.462146+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T21:39:54.444353+0000","last_clean_scrub_stamp":"2023-01-24T21:39:54.444353+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T01:39:36.790147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":99,"num_write_kb":1110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5032,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366808,"statfs":{"total":96636764160,"available":96631611392,"internally_reserved":0,"allocated":98304,"data_stored":23440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23200000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738370,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5032,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366808,"statfs":{"total":96636764160,"available":96631611392,"internally_reserved":0,"allocated":98304,"data_stored":23440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.188}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738370,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5024,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366816,"statfs":{"total":96636764160,"available":96631619584,"internally_reserved":0,"allocated":90112,"data_stored":20016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-24T21:39:59.225 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-01-24T21:39:59.225 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-01-24T21:39:59.226 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-01-24T21:39:59.226 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-01-24T21:39:59.616 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-24T21:39:59.617 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-01-24T21:39:59.630 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-01-24T21:39:59.630 INFO:teuthology.run_tasks:Running task workunit... 2023-01-24T21:39:59.644 INFO:tasks.workunit:Pulling workunits from ref 49f8fb05584886826e8eade75f7105fba754560c 2023-01-24T21:39:59.645 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-01-24T21:39:59.645 INFO:tasks.workunit:timeout=3h 2023-01-24T21:39:59.645 INFO:tasks.workunit:cleanup=True 2023-01-24T21:39:59.646 DEBUG:teuthology.orchestra.run.smithi007:> stat -- /home/ubuntu/cephtest/mnt.0 2023-01-24T21:39:59.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-24T21:39:59.661 INFO:teuthology.orchestra.run.smithi007.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-01-24T21:39:59.661 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-01-24T21:39:59.716 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-01-24T21:39:59.717 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-01-24T21:39:59.772 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 49f8fb05584886826e8eade75f7105fba754560c 2023-01-24T21:39:59.828 INFO:tasks.workunit.client.0.smithi007.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-01-24T21:40:40.726 INFO:tasks.workunit.client.0.smithi007.stderr:Note: switching to '49f8fb05584886826e8eade75f7105fba754560c'. 2023-01-24T21:40:40.726 INFO:tasks.workunit.client.0.smithi007.stderr: 2023-01-24T21:40:40.726 INFO:tasks.workunit.client.0.smithi007.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-01-24T21:40:40.727 INFO:tasks.workunit.client.0.smithi007.stderr:changes and commit them, and you can discard any commits you make in this 2023-01-24T21:40:40.727 INFO:tasks.workunit.client.0.smithi007.stderr:state without impacting any branches by switching back to a branch. 2023-01-24T21:40:40.727 INFO:tasks.workunit.client.0.smithi007.stderr: 2023-01-24T21:40:40.727 INFO:tasks.workunit.client.0.smithi007.stderr:If you want to create a new branch to retain commits you create, you may 2023-01-24T21:40:40.727 INFO:tasks.workunit.client.0.smithi007.stderr:do so (now or later) by using -c with the switch command. Example: 2023-01-24T21:40:40.728 INFO:tasks.workunit.client.0.smithi007.stderr: 2023-01-24T21:40:40.728 INFO:tasks.workunit.client.0.smithi007.stderr: git switch -c 2023-01-24T21:40:40.728 INFO:tasks.workunit.client.0.smithi007.stderr: 2023-01-24T21:40:40.728 INFO:tasks.workunit.client.0.smithi007.stderr:Or undo this operation with: 2023-01-24T21:40:40.728 INFO:tasks.workunit.client.0.smithi007.stderr: 2023-01-24T21:40:40.729 INFO:tasks.workunit.client.0.smithi007.stderr: git switch - 2023-01-24T21:40:40.729 INFO:tasks.workunit.client.0.smithi007.stderr: 2023-01-24T21:40:40.729 INFO:tasks.workunit.client.0.smithi007.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-01-24T21:40:40.729 INFO:tasks.workunit.client.0.smithi007.stderr: 2023-01-24T21:40:40.729 INFO:tasks.workunit.client.0.smithi007.stderr:HEAD is now at 49f8fb05584 Merge branch 'wip-58543-quincy' of https://github.com/ivancich/ceph-fork into wip-yuri7-testing-2023-01-23-1532-quincy 2023-01-24T21:40:40.731 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-01-24T21:40:40.794 INFO:tasks.workunit.client.0.smithi007.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-01-24T21:40:40.796 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-01-24T21:40:40.797 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-01-24T21:40:41.359 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-01-24T21:40:41.431 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-01-24T21:40:41.471 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-01-24T21:40:41.473 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-01-24T21:40:41.473 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-01-24T21:40:41.516 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-01-24T21:40:41.517 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-24T21:40:41.517 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-01-24T21:40:41.572 INFO:tasks.workunit:Running workunits matching cephtool on client.0... 2023-01-24T21:40:41.573 INFO:tasks.workunit:Running workunit cephtool/test.sh... 2023-01-24T21:40:41.574 DEBUG:teuthology.orchestra.run.smithi007:workunit test cephtool/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=49f8fb05584886826e8eade75f7105fba754560c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh 2023-01-24T21:40:41.631 INFO:tasks.workunit.client.0.smithi007.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh 2023-01-24T21:40:41.633 INFO:tasks.workunit.client.0.smithi007.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh 2023-01-24T21:40:41.633 INFO:tasks.workunit.client.0.smithi007.stderr:++ TIMEOUT=300 2023-01-24T21:40:41.634 INFO:tasks.workunit.client.0.smithi007.stderr:++ WAIT_FOR_CLEAN_TIMEOUT=90 2023-01-24T21:40:41.634 INFO:tasks.workunit.client.0.smithi007.stderr:++ MAX_TIMEOUT=15 2023-01-24T21:40:41.634 INFO:tasks.workunit.client.0.smithi007.stderr:++ PG_NUM=4 2023-01-24T21:40:41.634 INFO:tasks.workunit.client.0.smithi007.stderr:++ TMPDIR=/tmp 2023-01-24T21:40:41.634 INFO:tasks.workunit.client.0.smithi007.stderr:++ CEPH_BUILD_VIRTUALENV=/tmp 2023-01-24T21:40:41.635 INFO:tasks.workunit.client.0.smithi007.stderr:++ TESTDIR=/home/ubuntu/cephtest 2023-01-24T21:40:41.635 INFO:tasks.workunit.client.0.smithi007.stderr:++ type xmlstarlet 2023-01-24T21:40:41.635 INFO:tasks.workunit.client.0.smithi007.stderr:++ XMLSTARLET=xmlstarlet 2023-01-24T21:40:41.635 INFO:tasks.workunit.client.0.smithi007.stderr:+++ uname 2023-01-24T21:40:41.635 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' Linux = FreeBSD ']' 2023-01-24T21:40:41.636 INFO:tasks.workunit.client.0.smithi007.stderr:++ SED=sed 2023-01-24T21:40:41.636 INFO:tasks.workunit.client.0.smithi007.stderr:++ AWK=awk 2023-01-24T21:40:41.636 INFO:tasks.workunit.client.0.smithi007.stderr:+++ stty -a 2023-01-24T21:40:41.636 INFO:tasks.workunit.client.0.smithi007.stderr:+++ head -1 2023-01-24T21:40:41.636 INFO:tasks.workunit.client.0.smithi007.stderr:+++ sed -e 's/.*columns \([0-9]*\).*/\1/' 2023-01-24T21:40:41.637 INFO:tasks.workunit.client.0.smithi007.stderr:stty: 'standard input': Inappropriate ioctl for device 2023-01-24T21:40:41.637 INFO:tasks.workunit.client.0.smithi007.stderr:++ termwidth= 2023-01-24T21:40:41.638 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -n '' -a '' '!=' 0 ']' 2023-01-24T21:40:41.638 INFO:tasks.workunit.client.0.smithi007.stderr:++ DIFFCOLOPTS='-y ' 2023-01-24T21:40:41.638 INFO:tasks.workunit.client.0.smithi007.stderr:++ KERNCORE=kernel.core_pattern 2023-01-24T21:40:41.638 INFO:tasks.workunit.client.0.smithi007.stderr:++ EXTRA_OPTS= 2023-01-24T21:40:41.640 INFO:tasks.workunit.client.0.smithi007.stderr:++ test '' = TESTS 2023-01-24T21:40:41.641 INFO:tasks.workunit.client.0.smithi007.stderr:+ set -e 2023-01-24T21:40:41.641 INFO:tasks.workunit.client.0.smithi007.stderr:+ set -o functrace 2023-01-24T21:40:41.641 INFO:tasks.workunit.client.0.smithi007.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2023-01-24T21:40:41.641 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:11: main: SUDO=sudo 2023-01-24T21:40:41.642 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:12: main: export CEPH_DEV=1 2023-01-24T21:40:41.642 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:12: main: CEPH_DEV=1 2023-01-24T21:40:41.642 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:45: main: mktemp -d /tmp/cephtool.XXX 2023-01-24T21:40:41.643 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:45: main: TEMP_DIR=/tmp/cephtool.5YU 2023-01-24T21:40:41.643 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:46: main: trap 'rm -fr /tmp/cephtool.5YU' 0 2023-01-24T21:40:41.643 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:48: main: mktemp /tmp/cephtool.5YU/test_invalid.XXX 2023-01-24T21:40:41.643 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:48: main: TMPFILE=/tmp/cephtool.5YU/test_invalid.fWm 2023-01-24T21:40:41.652 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2840: main: set +x 2023-01-24T21:40:42.078 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'rbd' already exists 2023-01-24T21:40:43.377 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2972: main: test_mon_injectargs 2023-01-24T21:40:43.378 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:201: test_mon_injectargs: ceph tell osd.0 injectargs --no-osd_enable_op_tracker 2023-01-24T21:40:43.510 INFO:tasks.workunit.client.0.smithi007.stdout:{} 2023-01-24T21:40:43.521 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:202: test_mon_injectargs: ceph tell osd.0 config get osd_enable_op_tracker 2023-01-24T21:40:43.521 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:202: test_mon_injectargs: grep false 2023-01-24T21:40:43.658 INFO:tasks.workunit.client.0.smithi007.stdout: "osd_enable_op_tracker": "false" 2023-01-24T21:40:43.658 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:203: test_mon_injectargs: ceph tell osd.0 injectargs '--osd_enable_op_tracker --osd_op_history_duration 500' 2023-01-24T21:40:43.807 INFO:tasks.workunit.client.0.smithi007.stdout:{} 2023-01-24T21:40:43.818 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:204: test_mon_injectargs: ceph tell osd.0 config get osd_enable_op_tracker 2023-01-24T21:40:43.818 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:204: test_mon_injectargs: grep true 2023-01-24T21:40:43.955 INFO:tasks.workunit.client.0.smithi007.stdout: "osd_enable_op_tracker": "true" 2023-01-24T21:40:43.956 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:205: test_mon_injectargs: ceph tell osd.0 config get osd_op_history_duration 2023-01-24T21:40:43.956 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:205: test_mon_injectargs: grep 500 2023-01-24T21:40:44.093 INFO:tasks.workunit.client.0.smithi007.stdout: "osd_op_history_duration": "500" 2023-01-24T21:40:44.093 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:206: test_mon_injectargs: ceph tell osd.0 injectargs --no-osd_enable_op_tracker 2023-01-24T21:40:44.224 INFO:tasks.workunit.client.0.smithi007.stdout:{} 2023-01-24T21:40:44.234 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:207: test_mon_injectargs: ceph tell osd.0 config get osd_enable_op_tracker 2023-01-24T21:40:44.234 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:207: test_mon_injectargs: grep false 2023-01-24T21:40:44.371 INFO:tasks.workunit.client.0.smithi007.stdout: "osd_enable_op_tracker": "false" 2023-01-24T21:40:44.371 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:208: test_mon_injectargs: ceph tell osd.0 injectargs -- --osd_enable_op_tracker 2023-01-24T21:40:44.502 INFO:tasks.workunit.client.0.smithi007.stdout:{} 2023-01-24T21:40:44.513 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:209: test_mon_injectargs: ceph tell osd.0 config get osd_enable_op_tracker 2023-01-24T21:40:44.513 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:209: test_mon_injectargs: grep true 2023-01-24T21:40:44.650 INFO:tasks.workunit.client.0.smithi007.stdout: "osd_enable_op_tracker": "true" 2023-01-24T21:40:44.650 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:210: test_mon_injectargs: ceph tell osd.0 injectargs -- '--osd_enable_op_tracker --osd_op_history_duration 600' 2023-01-24T21:40:44.783 INFO:tasks.workunit.client.0.smithi007.stdout:{} 2023-01-24T21:40:44.793 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:211: test_mon_injectargs: ceph tell osd.0 config get osd_enable_op_tracker 2023-01-24T21:40:44.793 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:211: test_mon_injectargs: grep true 2023-01-24T21:40:44.930 INFO:tasks.workunit.client.0.smithi007.stdout: "osd_enable_op_tracker": "true" 2023-01-24T21:40:44.931 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:212: test_mon_injectargs: ceph tell osd.0 config get osd_op_history_duration 2023-01-24T21:40:44.931 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:212: test_mon_injectargs: grep 600 2023-01-24T21:40:45.068 INFO:tasks.workunit.client.0.smithi007.stdout: "osd_op_history_duration": "600" 2023-01-24T21:40:45.068 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:214: test_mon_injectargs: ceph tell osd.0 injectargs -- '--osd_deep_scrub_interval 2419200' 2023-01-24T21:40:45.200 INFO:tasks.workunit.client.0.smithi007.stdout:{} 2023-01-24T21:40:45.210 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:215: test_mon_injectargs: ceph tell osd.0 config get osd_deep_scrub_interval 2023-01-24T21:40:45.210 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:215: test_mon_injectargs: grep 2419200 2023-01-24T21:40:45.348 INFO:tasks.workunit.client.0.smithi007.stdout: "osd_deep_scrub_interval": "2419200.000000" 2023-01-24T21:40:45.348 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:217: test_mon_injectargs: ceph tell osd.0 injectargs -- '--mon_probe_timeout 2' 2023-01-24T21:40:45.480 INFO:tasks.workunit.client.0.smithi007.stdout:{} 2023-01-24T21:40:45.491 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:218: test_mon_injectargs: ceph tell osd.0 config get mon_probe_timeout 2023-01-24T21:40:45.491 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:218: test_mon_injectargs: grep 2 2023-01-24T21:40:45.628 INFO:tasks.workunit.client.0.smithi007.stdout: "mon_probe_timeout": "2.000000" 2023-01-24T21:40:45.629 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:220: test_mon_injectargs: ceph tell osd.0 injectargs -- '--mon-lease 6' 2023-01-24T21:40:45.759 INFO:tasks.workunit.client.0.smithi007.stdout:{} 2023-01-24T21:40:45.770 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:221: test_mon_injectargs: ceph tell osd.0 config get mon_lease 2023-01-24T21:40:45.770 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:221: test_mon_injectargs: grep 6 2023-01-24T21:40:45.907 INFO:tasks.workunit.client.0.smithi007.stdout: "mon_lease": "6.000000" 2023-01-24T21:40:45.907 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:224: test_mon_injectargs: expect_false ceph tell osd.0 injectargs --osd-scrub-auto-repair-num-errors -1 2023-01-24T21:40:46.026 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:225: test_mon_injectargs: check_response 'Error EINVAL: Parse error setting osd_scrub_auto_repair_num_errors to '\''-1'\'' using injectargs' 2023-01-24T21:40:46.027 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:103: check_response: expected_string='Error EINVAL: Parse error setting osd_scrub_auto_repair_num_errors to '\''-1'\'' using injectargs' 2023-01-24T21:40:46.027 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:104: check_response: retcode= 2023-01-24T21:40:46.027 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:105: check_response: expected_retcode= 2023-01-24T21:40:46.027 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:106: check_response: '[' '' -a '!=' ']' 2023-01-24T21:40:46.028 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:111: check_response: grep --quiet -- 'Error EINVAL: Parse error setting osd_scrub_auto_repair_num_errors to '\''-1'\'' using injectargs' /tmp/cephtool.5YU/test_invalid.fWm 2023-01-24T21:40:46.029 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:227: test_mon_injectargs: expect_failure /tmp/cephtool.5YU 'Option --osd_op_history_duration requires an argument' ceph tell osd.0 injectargs -- --osd_op_history_duration 2023-01-24T21:40:46.029 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:1892: expect_failure: local dir=/tmp/cephtool.5YU 2023-01-24T21:40:46.029 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:1893: expect_failure: shift 2023-01-24T21:40:46.029 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:1894: expect_failure: local 'expected=Option --osd_op_history_duration requires an argument' 2023-01-24T21:40:46.029 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:1895: expect_failure: shift 2023-01-24T21:40:46.030 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:1896: expect_failure: local success 2023-01-24T21:40:46.030 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:1898: expect_failure: ceph tell osd.0 injectargs -- --osd_op_history_duration 2023-01-24T21:40:46.148 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:1901: expect_failure: success=false 2023-01-24T21:40:46.148 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:1904: expect_failure: false 2023-01-24T21:40:46.148 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:1904: expect_failure: grep --quiet 'Option --osd_op_history_duration requires an argument' /tmp/cephtool.5YU/out 2023-01-24T21:40:46.149 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:1908: expect_failure: return 0 2023-01-24T21:40:46.149 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2973: main: set +x 2023-01-24T21:40:46.579 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2972: main: test_mon_injectargs_SI 2023-01-24T21:40:46.580 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:241: test_mon_injectargs_SI: get_config_value_or_die mon.a mon_pg_warn_min_objects 2023-01-24T21:40:46.580 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:120: get_config_value_or_die: local target config_opt raw val 2023-01-24T21:40:46.580 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:122: get_config_value_or_die: target=mon.a 2023-01-24T21:40:46.580 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:123: get_config_value_or_die: config_opt=mon_pg_warn_min_objects 2023-01-24T21:40:46.581 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:125: get_config_value_or_die: sudo ceph daemon mon.a config get mon_pg_warn_min_objects 2023-01-24T21:40:46.703 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:125: get_config_value_or_die: raw='{ 2023-01-24T21:40:46.704 INFO:tasks.workunit.client.0.smithi007.stderr: "mon_pg_warn_min_objects": "10000" 2023-01-24T21:40:46.704 INFO:tasks.workunit.client.0.smithi007.stderr:}' 2023-01-24T21:40:46.704 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:126: get_config_value_or_die: [[ 0 -ne 0 ]] 2023-01-24T21:40:46.704 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:131: get_config_value_or_die: echo '{' '"mon_pg_warn_min_objects":' '"10000"' '}' 2023-01-24T21:40:46.704 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:131: get_config_value_or_die: sed -e 's/[{} "]//g' 2023-01-24T21:40:46.705 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:131: get_config_value_or_die: raw=mon_pg_warn_min_objects:10000 2023-01-24T21:40:46.705 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:132: get_config_value_or_die: echo mon_pg_warn_min_objects:10000 2023-01-24T21:40:46.705 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:132: get_config_value_or_die: cut -f2 -d: 2023-01-24T21:40:46.706 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:132: get_config_value_or_die: val=10000 2023-01-24T21:40:46.707 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:134: get_config_value_or_die: echo 10000 2023-01-24T21:40:46.707 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:135: get_config_value_or_die: return 0 2023-01-24T21:40:46.707 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:241: test_mon_injectargs_SI: initial_value=10000 2023-01-24T21:40:46.707 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:242: test_mon_injectargs_SI: sudo ceph daemon mon.a config set mon_pg_warn_min_objects 10 2023-01-24T21:40:46.819 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2023-01-24T21:40:46.819 INFO:tasks.workunit.client.0.smithi007.stdout: "success": "mon_pg_warn_min_objects = '10' (not observed, change may require restart) " 2023-01-24T21:40:46.819 INFO:tasks.workunit.client.0.smithi007.stdout:} 2023-01-24T21:40:46.830 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:243: test_mon_injectargs_SI: expect_config_value mon.a mon_pg_warn_min_objects 10 2023-01-24T21:40:46.830 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:140: expect_config_value: local target config_opt expected_val val 2023-01-24T21:40:46.830 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:141: expect_config_value: target=mon.a 2023-01-24T21:40:46.830 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:142: expect_config_value: config_opt=mon_pg_warn_min_objects 2023-01-24T21:40:46.831 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:143: expect_config_value: expected_val=10 2023-01-24T21:40:46.831 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:145: expect_config_value: get_config_value_or_die mon.a mon_pg_warn_min_objects 2023-01-24T21:40:46.831 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:120: get_config_value_or_die: local target config_opt raw val 2023-01-24T21:40:46.831 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:122: get_config_value_or_die: target=mon.a 2023-01-24T21:40:46.831 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:123: get_config_value_or_die: config_opt=mon_pg_warn_min_objects 2023-01-24T21:40:46.832 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:125: get_config_value_or_die: sudo ceph daemon mon.a config get mon_pg_warn_min_objects 2023-01-24T21:40:46.952 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:125: get_config_value_or_die: raw='{ 2023-01-24T21:40:46.953 INFO:tasks.workunit.client.0.smithi007.stderr: "mon_pg_warn_min_objects": "10" 2023-01-24T21:40:46.953 INFO:tasks.workunit.client.0.smithi007.stderr:}' 2023-01-24T21:40:46.953 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:126: get_config_value_or_die: [[ 0 -ne 0 ]] 2023-01-24T21:40:46.954 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:131: get_config_value_or_die: echo '{' '"mon_pg_warn_min_objects":' '"10"' '}' 2023-01-24T21:40:46.954 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:131: get_config_value_or_die: sed -e 's/[{} "]//g' 2023-01-24T21:40:46.954 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:131: get_config_value_or_die: raw=mon_pg_warn_min_objects:10 2023-01-24T21:40:46.955 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:132: get_config_value_or_die: echo mon_pg_warn_min_objects:10 2023-01-24T21:40:46.955 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:132: get_config_value_or_die: cut -f2 -d: 2023-01-24T21:40:46.956 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:132: get_config_value_or_die: val=10 2023-01-24T21:40:46.956 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:134: get_config_value_or_die: echo 10 2023-01-24T21:40:46.957 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:135: get_config_value_or_die: return 0 2023-01-24T21:40:46.957 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:145: expect_config_value: val=10 2023-01-24T21:40:46.957 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:147: expect_config_value: [[ 10 != \1\0 ]] 2023-01-24T21:40:46.957 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:244: test_mon_injectargs_SI: sudo ceph daemon mon.a config set mon_pg_warn_min_objects 10K 2023-01-24T21:40:47.068 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2023-01-24T21:40:47.068 INFO:tasks.workunit.client.0.smithi007.stdout: "success": "mon_pg_warn_min_objects = '10000' (not observed, change may require restart) " 2023-01-24T21:40:47.069 INFO:tasks.workunit.client.0.smithi007.stdout:} 2023-01-24T21:40:47.079 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:245: test_mon_injectargs_SI: expect_config_value mon.a mon_pg_warn_min_objects 10000 2023-01-24T21:40:47.079 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:140: expect_config_value: local target config_opt expected_val val 2023-01-24T21:40:47.080 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:141: expect_config_value: target=mon.a 2023-01-24T21:40:47.080 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:142: expect_config_value: config_opt=mon_pg_warn_min_objects 2023-01-24T21:40:47.080 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:143: expect_config_value: expected_val=10000 2023-01-24T21:40:47.080 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:145: expect_config_value: get_config_value_or_die mon.a mon_pg_warn_min_objects 2023-01-24T21:40:47.080 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:120: get_config_value_or_die: local target config_opt raw val 2023-01-24T21:40:47.081 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:122: get_config_value_or_die: target=mon.a 2023-01-24T21:40:47.081 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:123: get_config_value_or_die: config_opt=mon_pg_warn_min_objects 2023-01-24T21:40:47.081 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:125: get_config_value_or_die: sudo ceph daemon mon.a config get mon_pg_warn_min_objects 2023-01-24T21:40:47.203 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:125: get_config_value_or_die: raw='{ 2023-01-24T21:40:47.204 INFO:tasks.workunit.client.0.smithi007.stderr: "mon_pg_warn_min_objects": "10000" 2023-01-24T21:40:47.204 INFO:tasks.workunit.client.0.smithi007.stderr:}' 2023-01-24T21:40:47.204 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:126: get_config_value_or_die: [[ 0 -ne 0 ]] 2023-01-24T21:40:47.204 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:131: get_config_value_or_die: echo '{' '"mon_pg_warn_min_objects":' '"10000"' '}' 2023-01-24T21:40:47.205 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:131: get_config_value_or_die: sed -e 's/[{} "]//g' 2023-01-24T21:40:47.205 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:131: get_config_value_or_die: raw=mon_pg_warn_min_objects:10000 2023-01-24T21:40:47.206 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:132: get_config_value_or_die: echo mon_pg_warn_min_objects:10000 2023-01-24T21:40:47.206 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:132: get_config_value_or_die: cut -f2 -d: 2023-01-24T21:40:47.207 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:132: get_config_value_or_die: val=10000 2023-01-24T21:40:47.207 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:134: get_config_value_or_die: echo 10000 2023-01-24T21:40:47.207 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:135: get_config_value_or_die: return 0 2023-01-24T21:40:47.207 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:145: expect_config_value: val=10000 2023-01-24T21:40:47.208 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:147: expect_config_value: [[ 10000 != \1\0\0\0\0 ]] 2023-01-24T21:40:47.208 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:246: test_mon_injectargs_SI: sudo ceph daemon mon.a config set mon_pg_warn_min_objects 1G 2023-01-24T21:40:47.318 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2023-01-24T21:40:47.318 INFO:tasks.workunit.client.0.smithi007.stdout: "success": "mon_pg_warn_min_objects = '1000000000' (not observed, change may require restart) " 2023-01-24T21:40:47.318 INFO:tasks.workunit.client.0.smithi007.stdout:} 2023-01-24T21:40:47.329 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:247: test_mon_injectargs_SI: expect_config_value mon.a mon_pg_warn_min_objects 1000000000 2023-01-24T21:40:47.330 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:140: expect_config_value: local target config_opt expected_val val 2023-01-24T21:40:47.330 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:141: expect_config_value: target=mon.a 2023-01-24T21:40:47.330 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:142: expect_config_value: config_opt=mon_pg_warn_min_objects 2023-01-24T21:40:47.331 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:143: expect_config_value: expected_val=1000000000 2023-01-24T21:40:47.331 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:145: expect_config_value: get_config_value_or_die mon.a mon_pg_warn_min_objects 2023-01-24T21:40:47.331 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:120: get_config_value_or_die: local target config_opt raw val 2023-01-24T21:40:47.331 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:122: get_config_value_or_die: target=mon.a 2023-01-24T21:40:47.331 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:123: get_config_value_or_die: config_opt=mon_pg_warn_min_objects 2023-01-24T21:40:47.331 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:125: get_config_value_or_die: sudo ceph daemon mon.a config get mon_pg_warn_min_objects 2023-01-24T21:40:47.453 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:125: get_config_value_or_die: raw='{ 2023-01-24T21:40:47.453 INFO:tasks.workunit.client.0.smithi007.stderr: "mon_pg_warn_min_objects": "1000000000" 2023-01-24T21:40:47.453 INFO:tasks.workunit.client.0.smithi007.stderr:}' 2023-01-24T21:40:47.453 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:126: get_config_value_or_die: [[ 0 -ne 0 ]] 2023-01-24T21:40:47.454 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:131: get_config_value_or_die: echo '{' '"mon_pg_warn_min_objects":' '"1000000000"' '}' 2023-01-24T21:40:47.454 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:131: get_config_value_or_die: sed -e 's/[{} "]//g' 2023-01-24T21:40:47.455 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:131: get_config_value_or_die: raw=mon_pg_warn_min_objects:1000000000 2023-01-24T21:40:47.455 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:132: get_config_value_or_die: echo mon_pg_warn_min_objects:1000000000 2023-01-24T21:40:47.455 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:132: get_config_value_or_die: cut -f2 -d: 2023-01-24T21:40:47.456 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:132: get_config_value_or_die: val=1000000000 2023-01-24T21:40:47.457 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:134: get_config_value_or_die: echo 1000000000 2023-01-24T21:40:47.457 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:135: get_config_value_or_die: return 0 2023-01-24T21:40:47.457 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:145: expect_config_value: val=1000000000 2023-01-24T21:40:47.457 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:147: expect_config_value: [[ 1000000000 != \1\0\0\0\0\0\0\0\0\0 ]] 2023-01-24T21:40:47.457 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:248: test_mon_injectargs_SI: sudo ceph daemon mon.a config set mon_pg_warn_min_objects 10F 2023-01-24T21:40:47.580 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:249: test_mon_injectargs_SI: check_response '(22) Invalid argument' 2023-01-24T21:40:47.580 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:103: check_response: expected_string='(22) Invalid argument' 2023-01-24T21:40:47.580 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:104: check_response: retcode= 2023-01-24T21:40:47.581 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:105: check_response: expected_retcode= 2023-01-24T21:40:47.581 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:106: check_response: '[' '' -a '!=' ']' 2023-01-24T21:40:47.581 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:111: check_response: grep --quiet -- '(22) Invalid argument' /tmp/cephtool.5YU/test_invalid.fWm 2023-01-24T21:40:47.581 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:251: test_mon_injectargs_SI: ceph tell mon.a injectargs '--mon_pg_warn_min_objects 10' 2023-01-24T21:40:47.697 INFO:tasks.workunit.client.0.smithi007.stdout:{} 2023-01-24T21:40:47.707 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:252: test_mon_injectargs_SI: expect_config_value mon.a mon_pg_warn_min_objects 10 2023-01-24T21:40:47.708 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:140: expect_config_value: local target config_opt expected_val val 2023-01-24T21:40:47.708 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:141: expect_config_value: target=mon.a 2023-01-24T21:40:47.708 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:142: expect_config_value: config_opt=mon_pg_warn_min_objects 2023-01-24T21:40:47.708 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:143: expect_config_value: expected_val=10 2023-01-24T21:40:47.709 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:145: expect_config_value: get_config_value_or_die mon.a mon_pg_warn_min_objects 2023-01-24T21:40:47.709 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:120: get_config_value_or_die: local target config_opt raw val 2023-01-24T21:40:47.709 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:122: get_config_value_or_die: target=mon.a 2023-01-24T21:40:47.709 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:123: get_config_value_or_die: config_opt=mon_pg_warn_min_objects 2023-01-24T21:40:47.709 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:125: get_config_value_or_die: sudo ceph daemon mon.a config get mon_pg_warn_min_objects 2023-01-24T21:40:47.830 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:125: get_config_value_or_die: raw='{ 2023-01-24T21:40:47.830 INFO:tasks.workunit.client.0.smithi007.stderr: "mon_pg_warn_min_objects": "10" 2023-01-24T21:40:47.831 INFO:tasks.workunit.client.0.smithi007.stderr:}' 2023-01-24T21:40:47.831 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:126: get_config_value_or_die: [[ 0 -ne 0 ]] 2023-01-24T21:40:47.831 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:131: get_config_value_or_die: echo '{' '"mon_pg_warn_min_objects":' '"10"' '}' 2023-01-24T21:40:47.832 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:131: get_config_value_or_die: sed -e 's/[{} "]//g' 2023-01-24T21:40:47.832 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:131: get_config_value_or_die: raw=mon_pg_warn_min_objects:10 2023-01-24T21:40:47.833 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:132: get_config_value_or_die: echo mon_pg_warn_min_objects:10 2023-01-24T21:40:47.833 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:132: get_config_value_or_die: cut -f2 -d: 2023-01-24T21:40:47.834 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:132: get_config_value_or_die: val=10 2023-01-24T21:40:47.834 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:134: get_config_value_or_die: echo 10 2023-01-24T21:40:47.834 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:135: get_config_value_or_die: return 0 2023-01-24T21:40:47.834 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:145: expect_config_value: val=10 2023-01-24T21:40:47.835 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:147: expect_config_value: [[ 10 != \1\0 ]] 2023-01-24T21:40:47.835 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:253: test_mon_injectargs_SI: ceph tell mon.a injectargs '--mon_pg_warn_min_objects 10K' 2023-01-24T21:40:47.954 INFO:tasks.workunit.client.0.smithi007.stdout:{} 2023-01-24T21:40:47.964 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:254: test_mon_injectargs_SI: expect_config_value mon.a mon_pg_warn_min_objects 10000 2023-01-24T21:40:47.964 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:140: expect_config_value: local target config_opt expected_val val 2023-01-24T21:40:47.965 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:141: expect_config_value: target=mon.a 2023-01-24T21:40:47.965 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:142: expect_config_value: config_opt=mon_pg_warn_min_objects 2023-01-24T21:40:47.965 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:143: expect_config_value: expected_val=10000 2023-01-24T21:40:47.965 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:145: expect_config_value: get_config_value_or_die mon.a mon_pg_warn_min_objects 2023-01-24T21:40:47.965 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:120: get_config_value_or_die: local target config_opt raw val 2023-01-24T21:40:47.966 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:122: get_config_value_or_die: target=mon.a 2023-01-24T21:40:47.966 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:123: get_config_value_or_die: config_opt=mon_pg_warn_min_objects 2023-01-24T21:40:47.966 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:125: get_config_value_or_die: sudo ceph daemon mon.a config get mon_pg_warn_min_objects 2023-01-24T21:40:48.087 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:125: get_config_value_or_die: raw='{ 2023-01-24T21:40:48.087 INFO:tasks.workunit.client.0.smithi007.stderr: "mon_pg_warn_min_objects": "10000" 2023-01-24T21:40:48.087 INFO:tasks.workunit.client.0.smithi007.stderr:}' 2023-01-24T21:40:48.088 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:126: get_config_value_or_die: [[ 0 -ne 0 ]] 2023-01-24T21:40:48.088 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:131: get_config_value_or_die: echo '{' '"mon_pg_warn_min_objects":' '"10000"' '}' 2023-01-24T21:40:48.088 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:131: get_config_value_or_die: sed -e 's/[{} "]//g' 2023-01-24T21:40:48.089 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:131: get_config_value_or_die: raw=mon_pg_warn_min_objects:10000 2023-01-24T21:40:48.089 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:132: get_config_value_or_die: echo mon_pg_warn_min_objects:10000 2023-01-24T21:40:48.089 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:132: get_config_value_or_die: cut -f2 -d: 2023-01-24T21:40:48.090 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:132: get_config_value_or_die: val=10000 2023-01-24T21:40:48.090 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:134: get_config_value_or_die: echo 10000 2023-01-24T21:40:48.091 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:135: get_config_value_or_die: return 0 2023-01-24T21:40:48.091 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:145: expect_config_value: val=10000 2023-01-24T21:40:48.091 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:147: expect_config_value: [[ 10000 != \1\0\0\0\0 ]] 2023-01-24T21:40:48.091 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:255: test_mon_injectargs_SI: ceph tell mon.a injectargs '--mon_pg_warn_min_objects 1G' 2023-01-24T21:40:48.206 INFO:tasks.workunit.client.0.smithi007.stdout:{} 2023-01-24T21:40:48.217 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:256: test_mon_injectargs_SI: expect_config_value mon.a mon_pg_warn_min_objects 1000000000 2023-01-24T21:40:48.217 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:140: expect_config_value: local target config_opt expected_val val 2023-01-24T21:40:48.217 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:141: expect_config_value: target=mon.a 2023-01-24T21:40:48.217 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:142: expect_config_value: config_opt=mon_pg_warn_min_objects 2023-01-24T21:40:48.218 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:143: expect_config_value: expected_val=1000000000 2023-01-24T21:40:48.218 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:145: expect_config_value: get_config_value_or_die mon.a mon_pg_warn_min_objects 2023-01-24T21:40:48.218 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:120: get_config_value_or_die: local target config_opt raw val 2023-01-24T21:40:48.218 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:122: get_config_value_or_die: target=mon.a 2023-01-24T21:40:48.219 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:123: get_config_value_or_die: config_opt=mon_pg_warn_min_objects 2023-01-24T21:40:48.223 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:125: get_config_value_or_die: sudo ceph daemon mon.a config get mon_pg_warn_min_objects 2023-01-24T21:40:48.340 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:125: get_config_value_or_die: raw='{ 2023-01-24T21:40:48.340 INFO:tasks.workunit.client.0.smithi007.stderr: "mon_pg_warn_min_objects": "1000000000" 2023-01-24T21:40:48.341 INFO:tasks.workunit.client.0.smithi007.stderr:}' 2023-01-24T21:40:48.341 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:126: get_config_value_or_die: [[ 0 -ne 0 ]] 2023-01-24T21:40:48.342 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:131: get_config_value_or_die: echo '{' '"mon_pg_warn_min_objects":' '"1000000000"' '}' 2023-01-24T21:40:48.342 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:131: get_config_value_or_die: sed -e 's/[{} "]//g' 2023-01-24T21:40:48.344 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:131: get_config_value_or_die: raw=mon_pg_warn_min_objects:1000000000 2023-01-24T21:40:48.345 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:132: get_config_value_or_die: echo mon_pg_warn_min_objects:1000000000 2023-01-24T21:40:48.345 INFO:tasks.workunit.client.0.smithi007.stderr:///home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:132: get_config_value_or_die: cut -f2 -d: 2023-01-24T21:40:48.346 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:132: get_config_value_or_die: val=1000000000 2023-01-24T21:40:48.346 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:134: get_config_value_or_die: echo 1000000000 2023-01-24T21:40:48.346 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:135: get_config_value_or_die: return 0 2023-01-24T21:40:48.347 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:145: expect_config_value: val=1000000000 2023-01-24T21:40:48.347 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:147: expect_config_value: [[ 1000000000 != \1\0\0\0\0\0\0\0\0\0 ]] 2023-01-24T21:40:48.347 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:257: test_mon_injectargs_SI: expect_false ceph tell mon.a injectargs '--mon_pg_warn_min_objects 10F' 2023-01-24T21:40:48.348 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:35: expect_false: set -x 2023-01-24T21:40:48.348 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: ceph tell mon.a injectargs '--mon_pg_warn_min_objects 10F' 2023-01-24T21:40:48.454 INFO:tasks.workunit.client.0.smithi007.stderr:Error EINVAL: Parse error setting mon_pg_warn_min_objects to '10F' using injectargs (strict_si_cast: unit prefix not recognized). 2023-01-24T21:40:48.454 INFO:tasks.workunit.client.0.smithi007.stderr: 2023-01-24T21:40:48.455 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: return 0 2023-01-24T21:40:48.456 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:258: test_mon_injectargs_SI: expect_false ceph tell mon.a injectargs '--mon_globalid_prealloc -1' 2023-01-24T21:40:48.456 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:35: expect_false: set -x 2023-01-24T21:40:48.457 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: ceph tell mon.a injectargs '--mon_globalid_prealloc -1' 2023-01-24T21:40:48.564 INFO:tasks.workunit.client.0.smithi007.stderr:Error EINVAL: Parse error setting mon_globalid_prealloc to '-1' using injectargs (strict_sistrtoll: value should not be negative). 2023-01-24T21:40:48.565 INFO:tasks.workunit.client.0.smithi007.stderr: 2023-01-24T21:40:48.566 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: return 0 2023-01-24T21:40:48.566 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:259: test_mon_injectargs_SI: sudo ceph daemon mon.a config set mon_pg_warn_min_objects 10000 2023-01-24T21:40:48.678 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2023-01-24T21:40:48.678 INFO:tasks.workunit.client.0.smithi007.stdout: "success": "mon_pg_warn_min_objects = '10000' (not observed, change may require restart) " 2023-01-24T21:40:48.679 INFO:tasks.workunit.client.0.smithi007.stdout:} 2023-01-24T21:40:48.688 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2973: main: set +x 2023-01-24T21:40:49.117 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2972: main: test_tiering_1 2023-01-24T21:40:49.117 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:339: test_tiering_1: ceph osd pool create slow 2 2023-01-24T21:40:49.577 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'slow' already exists 2023-01-24T21:40:49.587 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:340: test_tiering_1: ceph osd pool application enable slow rados 2023-01-24T21:40:51.462 INFO:tasks.workunit.client.0.smithi007.stderr:enabled application 'rados' on pool 'slow' 2023-01-24T21:40:51.474 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:341: test_tiering_1: ceph osd pool create slow2 2 2023-01-24T21:40:52.593 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'slow2' already exists 2023-01-24T21:40:52.603 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:342: test_tiering_1: ceph osd pool application enable slow2 rados 2023-01-24T21:40:54.473 INFO:tasks.workunit.client.0.smithi007.stderr:enabled application 'rados' on pool 'slow2' 2023-01-24T21:40:54.485 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:343: test_tiering_1: ceph osd pool create cache 2 2023-01-24T21:40:55.608 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cache' already exists 2023-01-24T21:40:55.618 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:344: test_tiering_1: ceph osd pool create cache2 2 2023-01-24T21:40:56.610 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cache2' already exists 2023-01-24T21:40:56.619 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:345: test_tiering_1: ceph osd tier add slow cache 2023-01-24T21:40:57.633 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cache' is now (or already was) a tier of 'slow' 2023-01-24T21:40:57.642 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:346: test_tiering_1: ceph osd tier add slow cache2 2023-01-24T21:40:58.637 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cache2' is now (or already was) a tier of 'slow' 2023-01-24T21:40:58.646 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:347: test_tiering_1: expect_false ceph osd tier add slow2 cache 2023-01-24T21:40:58.646 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:35: expect_false: set -x 2023-01-24T21:40:58.647 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: ceph osd tier add slow2 cache 2023-01-24T21:40:58.964 INFO:tasks.workunit.client.0.smithi007.stderr:Error EINVAL: tier pool 'cache' is already a tier of 'slow' 2023-01-24T21:40:58.965 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: return 0 2023-01-24T21:40:58.966 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:349: test_tiering_1: ceph osd pool ls detail -f json 2023-01-24T21:40:58.966 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:349: test_tiering_1: jq '.[] | select(.pool_name == "slow") | .application_metadata["rados"]' 2023-01-24T21:40:58.967 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:349: test_tiering_1: grep '{}' 2023-01-24T21:40:59.393 INFO:tasks.workunit.client.0.smithi007.stdout:{} 2023-01-24T21:40:59.393 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:350: test_tiering_1: ceph osd pool ls detail -f json 2023-01-24T21:40:59.394 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:350: test_tiering_1: jq '.[] | select(.pool_name == "slow2") | .application_metadata["rados"]' 2023-01-24T21:40:59.394 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:350: test_tiering_1: grep '{}' 2023-01-24T21:40:59.827 INFO:tasks.workunit.client.0.smithi007.stdout:{} 2023-01-24T21:40:59.827 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:351: test_tiering_1: ceph osd pool ls detail -f json 2023-01-24T21:40:59.828 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:351: test_tiering_1: jq '.[] | select(.pool_name == "cache") | .application_metadata["rados"]' 2023-01-24T21:40:59.828 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:351: test_tiering_1: grep '{}' 2023-01-24T21:41:00.255 INFO:tasks.workunit.client.0.smithi007.stdout:{} 2023-01-24T21:41:00.256 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:352: test_tiering_1: ceph osd pool ls detail -f json 2023-01-24T21:41:00.256 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:352: test_tiering_1: jq '.[] | select(.pool_name == "cache2") | .application_metadata["rados"]' 2023-01-24T21:41:00.256 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:352: test_tiering_1: grep '{}' 2023-01-24T21:41:00.684 INFO:tasks.workunit.client.0.smithi007.stdout:{} 2023-01-24T21:41:00.685 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:354: test_tiering_1: expect_false ceph osd tier cache-mode cache forward 2023-01-24T21:41:00.685 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:35: expect_false: set -x 2023-01-24T21:41:00.685 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: ceph osd tier cache-mode cache forward 2023-01-24T21:41:00.997 INFO:tasks.workunit.client.0.smithi007.stderr:Invalid command: forward not in writeback|readproxy|readonly|none 2023-01-24T21:41:00.997 INFO:tasks.workunit.client.0.smithi007.stderr:osd tier cache-mode [--yes-i-really-mean-it] : specify the caching mode for cache tier 2023-01-24T21:41:00.998 INFO:tasks.workunit.client.0.smithi007.stderr:Error EINVAL: invalid command 2023-01-24T21:41:00.999 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: return 0 2023-01-24T21:41:00.999 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:355: test_tiering_1: expect_false ceph osd tier cache-mode cache forward --yes-i-really-mean-it 2023-01-24T21:41:00.999 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:35: expect_false: set -x 2023-01-24T21:41:01.000 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: ceph osd tier cache-mode cache forward --yes-i-really-mean-it 2023-01-24T21:41:01.314 INFO:tasks.workunit.client.0.smithi007.stderr:Invalid command: forward not in writeback|readproxy|readonly|none 2023-01-24T21:41:01.315 INFO:tasks.workunit.client.0.smithi007.stderr:osd tier cache-mode [--yes-i-really-mean-it] : specify the caching mode for cache tier 2023-01-24T21:41:01.315 INFO:tasks.workunit.client.0.smithi007.stderr:Error EINVAL: invalid command 2023-01-24T21:41:01.316 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: return 0 2023-01-24T21:41:01.317 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:356: test_tiering_1: expect_false ceph osd tier cache-mode cache proxy 2023-01-24T21:41:01.317 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:35: expect_false: set -x 2023-01-24T21:41:01.317 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: ceph osd tier cache-mode cache proxy 2023-01-24T21:41:01.633 INFO:tasks.workunit.client.0.smithi007.stderr:Invalid command: proxy not in writeback|readproxy|readonly|none 2023-01-24T21:41:01.633 INFO:tasks.workunit.client.0.smithi007.stderr:osd tier cache-mode [--yes-i-really-mean-it] : specify the caching mode for cache tier 2023-01-24T21:41:01.633 INFO:tasks.workunit.client.0.smithi007.stderr:Error EINVAL: invalid command 2023-01-24T21:41:01.634 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: return 0 2023-01-24T21:41:01.635 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:357: test_tiering_1: expect_false ceph osd tier cache-mode cache proxy --yes-i-really-mean-it 2023-01-24T21:41:01.635 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:35: expect_false: set -x 2023-01-24T21:41:01.635 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: ceph osd tier cache-mode cache proxy --yes-i-really-mean-it 2023-01-24T21:41:01.948 INFO:tasks.workunit.client.0.smithi007.stderr:Invalid command: proxy not in writeback|readproxy|readonly|none 2023-01-24T21:41:01.948 INFO:tasks.workunit.client.0.smithi007.stderr:osd tier cache-mode [--yes-i-really-mean-it] : specify the caching mode for cache tier 2023-01-24T21:41:01.949 INFO:tasks.workunit.client.0.smithi007.stderr:Error EINVAL: invalid command 2023-01-24T21:41:01.950 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: return 0 2023-01-24T21:41:01.950 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:359: test_tiering_1: ceph osd tier cache-mode cache writeback 2023-01-24T21:41:02.642 INFO:tasks.workunit.client.0.smithi007.stderr:set cache-mode for pool 'cache' to writeback 2023-01-24T21:41:02.651 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:360: test_tiering_1: expect_false ceph osd tier cache-mode cache readonly 2023-01-24T21:41:02.651 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:35: expect_false: set -x 2023-01-24T21:41:02.652 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: ceph osd tier cache-mode cache readonly 2023-01-24T21:41:02.968 INFO:tasks.workunit.client.0.smithi007.stderr:Error EPERM: 'readonly' is not a well-supported cache mode and may corrupt your data. pass --yes-i-really-mean-it to force. 2023-01-24T21:41:02.970 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: return 0 2023-01-24T21:41:02.970 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:361: test_tiering_1: expect_false ceph osd tier cache-mode cache readonly --yes-i-really-mean-it 2023-01-24T21:41:02.971 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:35: expect_false: set -x 2023-01-24T21:41:02.971 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: ceph osd tier cache-mode cache readonly --yes-i-really-mean-it 2023-01-24T21:41:03.290 INFO:tasks.workunit.client.0.smithi007.stderr:Error EINVAL: unable to set cache-mode 'readonly' on a 'writeback' pool; only 'readproxy' allowed. 2023-01-24T21:41:03.291 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: return 0 2023-01-24T21:41:03.292 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:362: test_tiering_1: ceph osd tier cache-mode cache readproxy 2023-01-24T21:41:04.652 INFO:tasks.workunit.client.0.smithi007.stderr:set cache-mode for pool 'cache' to readproxy 2023-01-24T21:41:04.663 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:363: test_tiering_1: ceph osd tier cache-mode cache none 2023-01-24T21:41:05.656 INFO:tasks.workunit.client.0.smithi007.stderr:set cache-mode for pool 'cache' to none 2023-01-24T21:41:05.665 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:364: test_tiering_1: ceph osd tier cache-mode cache readonly --yes-i-really-mean-it 2023-01-24T21:41:06.659 INFO:tasks.workunit.client.0.smithi007.stderr:set cache-mode for pool 'cache' to readonly 2023-01-24T21:41:06.668 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:365: test_tiering_1: ceph osd tier cache-mode cache none 2023-01-24T21:41:07.661 INFO:tasks.workunit.client.0.smithi007.stderr:set cache-mode for pool 'cache' to none 2023-01-24T21:41:07.671 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:366: test_tiering_1: ceph osd tier cache-mode cache writeback 2023-01-24T21:41:08.665 INFO:tasks.workunit.client.0.smithi007.stderr:set cache-mode for pool 'cache' to writeback 2023-01-24T21:41:08.674 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:367: test_tiering_1: expect_false ceph osd tier cache-mode cache none 2023-01-24T21:41:08.675 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:35: expect_false: set -x 2023-01-24T21:41:08.675 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: ceph osd tier cache-mode cache none 2023-01-24T21:41:08.991 INFO:tasks.workunit.client.0.smithi007.stderr:Error EINVAL: unable to set cache-mode 'none' on a 'writeback' pool; only 'readproxy' allowed. 2023-01-24T21:41:08.993 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: return 0 2023-01-24T21:41:08.993 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:368: test_tiering_1: expect_false ceph osd tier cache-mode cache readonly --yes-i-really-mean-it 2023-01-24T21:41:08.993 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:35: expect_false: set -x 2023-01-24T21:41:08.993 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: ceph osd tier cache-mode cache readonly --yes-i-really-mean-it 2023-01-24T21:41:09.307 INFO:tasks.workunit.client.0.smithi007.stderr:Error EINVAL: unable to set cache-mode 'readonly' on a 'writeback' pool; only 'readproxy' allowed. 2023-01-24T21:41:09.309 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: return 0 2023-01-24T21:41:09.309 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:371: test_tiering_1: rados -p cache put /etc/passwd /etc/passwd 2023-01-24T21:41:09.341 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:372: test_tiering_1: flush_pg_stats 2023-01-24T21:41:09.341 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2127: flush_pg_stats: local timeout=300 2023-01-24T21:41:09.341 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2129: flush_pg_stats: ceph osd ls 2023-01-24T21:41:09.771 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2129: flush_pg_stats: ids='0 2023-01-24T21:41:09.771 INFO:tasks.workunit.client.0.smithi007.stderr:1 2023-01-24T21:41:09.772 INFO:tasks.workunit.client.0.smithi007.stderr:2' 2023-01-24T21:41:09.772 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2130: flush_pg_stats: seqs= 2023-01-24T21:41:09.772 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2131: flush_pg_stats: for osd in $ids 2023-01-24T21:41:09.773 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2132: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2023-01-24T21:41:09.910 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2132: flush_pg_stats: seq=34359738387 2023-01-24T21:41:09.910 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2133: flush_pg_stats: test -z 34359738387 2023-01-24T21:41:09.911 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2137: flush_pg_stats: seqs=' 0-34359738387' 2023-01-24T21:41:09.911 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2131: flush_pg_stats: for osd in $ids 2023-01-24T21:41:09.911 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2132: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2023-01-24T21:41:10.049 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2132: flush_pg_stats: seq=34359738387 2023-01-24T21:41:10.049 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2133: flush_pg_stats: test -z 34359738387 2023-01-24T21:41:10.049 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2137: flush_pg_stats: seqs=' 0-34359738387 1-34359738387' 2023-01-24T21:41:10.049 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2131: flush_pg_stats: for osd in $ids 2023-01-24T21:41:10.050 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2132: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2023-01-24T21:41:10.188 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2132: flush_pg_stats: seq=34359738388 2023-01-24T21:41:10.189 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2133: flush_pg_stats: test -z 34359738388 2023-01-24T21:41:10.189 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2137: flush_pg_stats: seqs=' 0-34359738387 1-34359738387 2-34359738388' 2023-01-24T21:41:10.189 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2140: flush_pg_stats: for s in $seqs 2023-01-24T21:41:10.189 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2141: flush_pg_stats: echo 0-34359738387 2023-01-24T21:41:10.190 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2141: flush_pg_stats: cut -d - -f 1 2023-01-24T21:41:10.190 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2141: flush_pg_stats: osd=0 2023-01-24T21:41:10.191 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2142: flush_pg_stats: echo 0-34359738387 2023-01-24T21:41:10.192 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2142: flush_pg_stats: cut -d - -f 2 2023-01-24T21:41:10.192 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2142: flush_pg_stats: seq=34359738387 2023-01-24T21:41:10.193 INFO:tasks.workunit.client.0.smithi007.stdout:waiting osd.0 seq 34359738387 2023-01-24T21:41:10.193 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2143: flush_pg_stats: echo 'waiting osd.0 seq 34359738387' 2023-01-24T21:41:10.193 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2144: flush_pg_stats: ceph osd last-stat-seq 0 2023-01-24T21:41:10.620 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2144: flush_pg_stats: test 34359738384 -lt 34359738387 2023-01-24T21:41:10.620 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2145: flush_pg_stats: sleep 1 2023-01-24T21:41:11.621 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2146: flush_pg_stats: '[' 300 -eq 0 ']' 2023-01-24T21:41:11.622 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2144: flush_pg_stats: ceph osd last-stat-seq 0 2023-01-24T21:41:12.065 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2144: flush_pg_stats: test 34359738387 -lt 34359738387 2023-01-24T21:41:12.065 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2140: flush_pg_stats: for s in $seqs 2023-01-24T21:41:12.065 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2141: flush_pg_stats: echo 1-34359738387 2023-01-24T21:41:12.066 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2141: flush_pg_stats: cut -d - -f 1 2023-01-24T21:41:12.066 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2141: flush_pg_stats: osd=1 2023-01-24T21:41:12.067 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2142: flush_pg_stats: echo 1-34359738387 2023-01-24T21:41:12.067 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2142: flush_pg_stats: cut -d - -f 2 2023-01-24T21:41:12.067 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2142: flush_pg_stats: seq=34359738387 2023-01-24T21:41:12.068 INFO:tasks.workunit.client.0.smithi007.stdout:waiting osd.1 seq 34359738387 2023-01-24T21:41:12.068 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2143: flush_pg_stats: echo 'waiting osd.1 seq 34359738387' 2023-01-24T21:41:12.069 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2144: flush_pg_stats: ceph osd last-stat-seq 1 2023-01-24T21:41:12.495 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2144: flush_pg_stats: test 34359738387 -lt 34359738387 2023-01-24T21:41:12.496 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2140: flush_pg_stats: for s in $seqs 2023-01-24T21:41:12.496 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2141: flush_pg_stats: echo 2-34359738388 2023-01-24T21:41:12.497 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2141: flush_pg_stats: cut -d - -f 1 2023-01-24T21:41:12.497 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2141: flush_pg_stats: osd=2 2023-01-24T21:41:12.497 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2142: flush_pg_stats: echo 2-34359738388 2023-01-24T21:41:12.498 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2142: flush_pg_stats: cut -d - -f 2 2023-01-24T21:41:12.498 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2142: flush_pg_stats: seq=34359738388 2023-01-24T21:41:12.498 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2143: flush_pg_stats: echo 'waiting osd.2 seq 34359738388' 2023-01-24T21:41:12.499 INFO:tasks.workunit.client.0.smithi007.stdout:waiting osd.2 seq 34359738388 2023-01-24T21:41:12.499 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2144: flush_pg_stats: ceph osd last-stat-seq 2 2023-01-24T21:41:12.929 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2144: flush_pg_stats: test 34359738388 -lt 34359738388 2023-01-24T21:41:12.930 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:374: test_tiering_1: ceph osd tier cache-mode cache readproxy 2023-01-24T21:41:13.672 INFO:tasks.workunit.client.0.smithi007.stderr:set cache-mode for pool 'cache' to readproxy 2023-01-24T21:41:13.681 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:375: test_tiering_1: expect_false ceph osd tier cache-mode cache none 2023-01-24T21:41:13.681 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:35: expect_false: set -x 2023-01-24T21:41:13.682 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: ceph osd tier cache-mode cache none 2023-01-24T21:41:13.996 INFO:tasks.workunit.client.0.smithi007.stderr:Error EBUSY: unable to set cache-mode 'none' on pool 'cache': dirty objects found 2023-01-24T21:41:13.998 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: return 0 2023-01-24T21:41:13.998 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:376: test_tiering_1: expect_false ceph osd tier cache-mode cache readonly --yes-i-really-mean-it 2023-01-24T21:41:13.998 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:35: expect_false: set -x 2023-01-24T21:41:13.998 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: ceph osd tier cache-mode cache readonly --yes-i-really-mean-it 2023-01-24T21:41:14.313 INFO:tasks.workunit.client.0.smithi007.stderr:Error EBUSY: unable to set cache-mode 'readonly' on pool 'cache': dirty objects found 2023-01-24T21:41:14.314 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: return 0 2023-01-24T21:41:14.314 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:377: test_tiering_1: ceph osd tier cache-mode cache writeback 2023-01-24T21:41:15.682 INFO:tasks.workunit.client.0.smithi007.stderr:set cache-mode for pool 'cache' to writeback 2023-01-24T21:41:15.691 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:379: test_tiering_1: rados -p cache rm /etc/passwd 2023-01-24T21:41:15.721 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:380: test_tiering_1: rados -p cache cache-flush-evict-all 2023-01-24T21:41:15.748 INFO:tasks.workunit.client.0.smithi007.stdout: /etc/passwd 2023-01-24T21:41:15.752 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:381: test_tiering_1: flush_pg_stats 2023-01-24T21:41:15.753 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2127: flush_pg_stats: local timeout=300 2023-01-24T21:41:15.753 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2129: flush_pg_stats: ceph osd ls 2023-01-24T21:41:16.181 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2129: flush_pg_stats: ids='0 2023-01-24T21:41:16.182 INFO:tasks.workunit.client.0.smithi007.stderr:1 2023-01-24T21:41:16.182 INFO:tasks.workunit.client.0.smithi007.stderr:2' 2023-01-24T21:41:16.182 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2130: flush_pg_stats: seqs= 2023-01-24T21:41:16.182 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2131: flush_pg_stats: for osd in $ids 2023-01-24T21:41:16.183 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2132: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2023-01-24T21:41:16.321 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2132: flush_pg_stats: seq=34359738390 2023-01-24T21:41:16.321 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2133: flush_pg_stats: test -z 34359738390 2023-01-24T21:41:16.322 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2137: flush_pg_stats: seqs=' 0-34359738390' 2023-01-24T21:41:16.322 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2131: flush_pg_stats: for osd in $ids 2023-01-24T21:41:16.322 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2132: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2023-01-24T21:41:16.459 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2132: flush_pg_stats: seq=34359738390 2023-01-24T21:41:16.460 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2133: flush_pg_stats: test -z 34359738390 2023-01-24T21:41:16.460 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2137: flush_pg_stats: seqs=' 0-34359738390 1-34359738390' 2023-01-24T21:41:16.460 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2131: flush_pg_stats: for osd in $ids 2023-01-24T21:41:16.460 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2132: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2023-01-24T21:41:16.601 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2132: flush_pg_stats: seq=34359738391 2023-01-24T21:41:16.601 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2133: flush_pg_stats: test -z 34359738391 2023-01-24T21:41:16.601 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2137: flush_pg_stats: seqs=' 0-34359738390 1-34359738390 2-34359738391' 2023-01-24T21:41:16.601 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2140: flush_pg_stats: for s in $seqs 2023-01-24T21:41:16.602 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2141: flush_pg_stats: echo 0-34359738390 2023-01-24T21:41:16.602 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2141: flush_pg_stats: cut -d - -f 1 2023-01-24T21:41:16.603 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2141: flush_pg_stats: osd=0 2023-01-24T21:41:16.603 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2142: flush_pg_stats: echo 0-34359738390 2023-01-24T21:41:16.603 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2142: flush_pg_stats: cut -d - -f 2 2023-01-24T21:41:16.604 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2142: flush_pg_stats: seq=34359738390 2023-01-24T21:41:16.604 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2143: flush_pg_stats: echo 'waiting osd.0 seq 34359738390' 2023-01-24T21:41:16.604 INFO:tasks.workunit.client.0.smithi007.stdout:waiting osd.0 seq 34359738390 2023-01-24T21:41:16.605 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2144: flush_pg_stats: ceph osd last-stat-seq 0 2023-01-24T21:41:17.032 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2144: flush_pg_stats: test 34359738388 -lt 34359738390 2023-01-24T21:41:17.033 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2145: flush_pg_stats: sleep 1 2023-01-24T21:41:18.034 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2146: flush_pg_stats: '[' 300 -eq 0 ']' 2023-01-24T21:41:18.034 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2144: flush_pg_stats: ceph osd last-stat-seq 0 2023-01-24T21:41:18.479 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2144: flush_pg_stats: test 34359738390 -lt 34359738390 2023-01-24T21:41:18.479 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2140: flush_pg_stats: for s in $seqs 2023-01-24T21:41:18.480 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2141: flush_pg_stats: echo 1-34359738390 2023-01-24T21:41:18.480 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2141: flush_pg_stats: cut -d - -f 1 2023-01-24T21:41:18.481 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2141: flush_pg_stats: osd=1 2023-01-24T21:41:18.481 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2142: flush_pg_stats: echo 1-34359738390 2023-01-24T21:41:18.482 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2142: flush_pg_stats: cut -d - -f 2 2023-01-24T21:41:18.482 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2142: flush_pg_stats: seq=34359738390 2023-01-24T21:41:18.482 INFO:tasks.workunit.client.0.smithi007.stdout:waiting osd.1 seq 34359738390 2023-01-24T21:41:18.483 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2143: flush_pg_stats: echo 'waiting osd.1 seq 34359738390' 2023-01-24T21:41:18.483 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2144: flush_pg_stats: ceph osd last-stat-seq 1 2023-01-24T21:41:18.911 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2144: flush_pg_stats: test 34359738390 -lt 34359738390 2023-01-24T21:41:18.911 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2140: flush_pg_stats: for s in $seqs 2023-01-24T21:41:18.912 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2141: flush_pg_stats: echo 2-34359738391 2023-01-24T21:41:18.912 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2141: flush_pg_stats: cut -d - -f 1 2023-01-24T21:41:18.913 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2141: flush_pg_stats: osd=2 2023-01-24T21:41:18.913 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2142: flush_pg_stats: echo 2-34359738391 2023-01-24T21:41:18.913 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2142: flush_pg_stats: cut -d - -f 2 2023-01-24T21:41:18.914 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2142: flush_pg_stats: seq=34359738391 2023-01-24T21:41:18.914 INFO:tasks.workunit.client.0.smithi007.stdout:waiting osd.2 seq 34359738391 2023-01-24T21:41:18.914 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2143: flush_pg_stats: echo 'waiting osd.2 seq 34359738391' 2023-01-24T21:41:18.915 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2144: flush_pg_stats: ceph osd last-stat-seq 2 2023-01-24T21:41:19.345 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2144: flush_pg_stats: test 34359738391 -lt 34359738391 2023-01-24T21:41:19.345 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:383: test_tiering_1: ceph osd tier cache-mode cache readproxy 2023-01-24T21:41:20.692 INFO:tasks.workunit.client.0.smithi007.stderr:set cache-mode for pool 'cache' to readproxy 2023-01-24T21:41:20.701 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:384: test_tiering_1: ceph osd tier cache-mode cache none 2023-01-24T21:41:21.697 INFO:tasks.workunit.client.0.smithi007.stderr:set cache-mode for pool 'cache' to none 2023-01-24T21:41:21.706 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:385: test_tiering_1: ceph osd tier cache-mode cache readonly --yes-i-really-mean-it 2023-01-24T21:41:22.698 INFO:tasks.workunit.client.0.smithi007.stderr:set cache-mode for pool 'cache' to readonly 2023-01-24T21:41:22.707 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:386: test_tiering_1: TRIES=0 2023-01-24T21:41:22.708 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:387: test_tiering_1: ceph osd pool set cache pg_num 3 --yes-i-really-mean-it 2023-01-24T21:41:24.573 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:394: test_tiering_1: expect_false ceph osd pool set cache pg_num 4 2023-01-24T21:41:24.573 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:35: expect_false: set -x 2023-01-24T21:41:24.573 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: ceph osd pool set cache pg_num 4 2023-01-24T21:41:24.875 INFO:tasks.workunit.client.0.smithi007.stderr:Error EPERM: splits in cache pools must be followed by scrubs and leave sufficient free space to avoid overfilling. use --yes-i-really-mean-it to force. 2023-01-24T21:41:24.877 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: return 0 2023-01-24T21:41:24.877 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:395: test_tiering_1: ceph osd tier cache-mode cache none 2023-01-24T21:41:25.708 INFO:tasks.workunit.client.0.smithi007.stderr:set cache-mode for pool 'cache' to none 2023-01-24T21:41:25.717 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:396: test_tiering_1: ceph osd tier set-overlay slow cache 2023-01-24T21:41:26.715 INFO:tasks.workunit.client.0.smithi007.stderr:overlay for 'slow' is now (or already was) 'cache' 2023-01-24T21:41:26.725 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:397: test_tiering_1: expect_false ceph osd tier set-overlay slow cache2 2023-01-24T21:41:26.725 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:35: expect_false: set -x 2023-01-24T21:41:26.725 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: ceph osd tier set-overlay slow cache2 2023-01-24T21:41:27.039 INFO:tasks.workunit.client.0.smithi007.stderr:Error EINVAL: pool 'slow' has overlay 'cache'; please remove-overlay first 2023-01-24T21:41:27.041 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: return 0 2023-01-24T21:41:27.041 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:398: test_tiering_1: expect_false ceph osd tier remove slow cache 2023-01-24T21:41:27.041 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:35: expect_false: set -x 2023-01-24T21:41:27.041 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: ceph osd tier remove slow cache 2023-01-24T21:41:27.358 INFO:tasks.workunit.client.0.smithi007.stderr:Error EBUSY: tier pool 'cache' is the overlay for 'slow'; please remove-overlay first 2023-01-24T21:41:27.359 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: return 0 2023-01-24T21:41:27.359 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:399: test_tiering_1: ceph osd tier remove-overlay slow 2023-01-24T21:41:28.728 INFO:tasks.workunit.client.0.smithi007.stderr:there is now (or already was) no overlay for 'slow' 2023-01-24T21:41:28.737 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:400: test_tiering_1: ceph osd tier set-overlay slow cache2 2023-01-24T21:41:29.727 INFO:tasks.workunit.client.0.smithi007.stderr:overlay for 'slow' is now (or already was) 'cache2' 2023-01-24T21:41:29.737 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:401: test_tiering_1: ceph osd tier remove-overlay slow 2023-01-24T21:41:30.730 INFO:tasks.workunit.client.0.smithi007.stderr:there is now (or already was) no overlay for 'slow' 2023-01-24T21:41:30.739 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:402: test_tiering_1: ceph osd tier remove slow cache 2023-01-24T21:41:31.734 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cache' is now (or already was) not a tier of 'slow' 2023-01-24T21:41:31.743 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:403: test_tiering_1: ceph osd tier add slow2 cache 2023-01-24T21:41:32.739 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cache' is now (or already was) a tier of 'slow2' 2023-01-24T21:41:32.749 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:404: test_tiering_1: expect_false ceph osd tier set-overlay slow cache 2023-01-24T21:41:32.749 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:35: expect_false: set -x 2023-01-24T21:41:32.749 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: ceph osd tier set-overlay slow cache 2023-01-24T21:41:33.063 INFO:tasks.workunit.client.0.smithi007.stderr:Error EINVAL: tier pool 'cache' is not a tier of 'slow' 2023-01-24T21:41:33.065 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: return 0 2023-01-24T21:41:33.065 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:405: test_tiering_1: ceph osd tier set-overlay slow2 cache 2023-01-24T21:41:33.741 INFO:tasks.workunit.client.0.smithi007.stderr:overlay for 'slow2' is now (or already was) 'cache' 2023-01-24T21:41:33.750 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:406: test_tiering_1: ceph osd tier remove-overlay slow2 2023-01-24T21:41:34.750 INFO:tasks.workunit.client.0.smithi007.stderr:there is now (or already was) no overlay for 'slow2' 2023-01-24T21:41:34.760 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:407: test_tiering_1: ceph osd tier remove slow2 cache 2023-01-24T21:41:35.753 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cache' is now (or already was) not a tier of 'slow2' 2023-01-24T21:41:35.762 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:408: test_tiering_1: ceph osd tier remove slow cache2 2023-01-24T21:41:36.756 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cache2' is now (or already was) not a tier of 'slow' 2023-01-24T21:41:36.765 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:411: test_tiering_1: rados -p cache2 put /etc/passwd /etc/passwd 2023-01-24T21:41:36.796 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:412: test_tiering_1: ceph df 2023-01-24T21:41:36.796 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:412: test_tiering_1: grep cache2 2023-01-24T21:41:36.796 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:412: test_tiering_1: grep ' 1 ' 2023-01-24T21:41:37.378 INFO:tasks.workunit.client.0.smithi007.stdout:waiting for pg stats to flush 2023-01-24T21:41:37.379 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:413: test_tiering_1: echo waiting for pg stats to flush 2023-01-24T21:41:37.379 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:414: test_tiering_1: sleep 2 2023-01-24T21:41:39.380 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:412: test_tiering_1: ceph df 2023-01-24T21:41:39.380 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:412: test_tiering_1: grep cache2 2023-01-24T21:41:39.381 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:412: test_tiering_1: grep ' 1 ' 2023-01-24T21:41:39.968 INFO:tasks.workunit.client.0.smithi007.stdout:waiting for pg stats to flush 2023-01-24T21:41:39.968 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:413: test_tiering_1: echo waiting for pg stats to flush 2023-01-24T21:41:39.969 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:414: test_tiering_1: sleep 2 2023-01-24T21:41:41.970 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:412: test_tiering_1: ceph df 2023-01-24T21:41:41.970 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:412: test_tiering_1: grep cache2 2023-01-24T21:41:41.970 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:412: test_tiering_1: grep ' 1 ' 2023-01-24T21:41:42.561 INFO:tasks.workunit.client.0.smithi007.stdout:cache2 6 2 10 KiB 1 24 KiB 0 128 GiB 2023-01-24T21:41:42.562 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:416: test_tiering_1: expect_false ceph osd tier add slow cache2 2023-01-24T21:41:42.562 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:35: expect_false: set -x 2023-01-24T21:41:42.562 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: ceph osd tier add slow cache2 2023-01-24T21:41:42.878 INFO:tasks.workunit.client.0.smithi007.stderr:Error ENOTEMPTY: tier pool 'cache2' is not empty; --force-nonempty to force 2023-01-24T21:41:42.879 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: return 0 2023-01-24T21:41:42.879 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:417: test_tiering_1: ceph osd tier add slow cache2 --force-nonempty 2023-01-24T21:41:43.600 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cache2' is now (or already was) a tier of 'slow' 2023-01-24T21:41:43.610 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:418: test_tiering_1: ceph osd tier remove slow cache2 2023-01-24T21:41:44.602 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cache2' is now (or already was) not a tier of 'slow' 2023-01-24T21:41:44.612 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:420: test_tiering_1: ceph osd pool ls 2023-01-24T21:41:44.613 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:420: test_tiering_1: grep cache2 2023-01-24T21:41:45.039 INFO:tasks.workunit.client.0.smithi007.stdout:cache2 2023-01-24T21:41:45.040 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:421: test_tiering_1: ceph osd pool ls -f json-pretty 2023-01-24T21:41:45.040 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:421: test_tiering_1: grep cache2 2023-01-24T21:41:45.464 INFO:tasks.workunit.client.0.smithi007.stdout: "cache2" 2023-01-24T21:41:45.465 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:422: test_tiering_1: ceph osd pool ls detail 2023-01-24T21:41:45.465 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:422: test_tiering_1: grep cache2 2023-01-24T21:41:45.894 INFO:tasks.workunit.client.0.smithi007.stdout:pool 6 'cache2' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 2 pgp_num 2 autoscale_mode off last_change 48 lfor 40/40/40 flags hashpspool stripe_width 0 application rados 2023-01-24T21:41:45.894 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:423: test_tiering_1: ceph osd pool ls detail -f json-pretty 2023-01-24T21:41:45.895 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:423: test_tiering_1: grep cache2 2023-01-24T21:41:46.319 INFO:tasks.workunit.client.0.smithi007.stdout: "pool_name": "cache2", 2023-01-24T21:41:46.319 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:425: test_tiering_1: ceph osd pool delete slow slow --yes-i-really-really-mean-it 2023-01-24T21:41:47.596 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'slow' does not exist 2023-01-24T21:41:47.606 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:426: test_tiering_1: ceph osd pool delete slow2 slow2 --yes-i-really-really-mean-it 2023-01-24T21:41:48.599 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'slow2' does not exist 2023-01-24T21:41:48.609 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:427: test_tiering_1: ceph osd pool delete cache cache --yes-i-really-really-mean-it 2023-01-24T21:41:49.607 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cache' does not exist 2023-01-24T21:41:49.617 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:428: test_tiering_1: ceph osd pool delete cache2 cache2 --yes-i-really-really-mean-it 2023-01-24T21:41:50.608 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cache2' does not exist 2023-01-24T21:41:50.617 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2973: main: set +x 2023-01-24T21:41:51.052 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2972: main: test_tiering_2 2023-01-24T21:41:51.053 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:434: test_tiering_2: ceph osd pool create snap_base 2 2023-01-24T21:41:51.614 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'snap_base' already exists 2023-01-24T21:41:51.624 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:435: test_tiering_2: ceph osd pool application enable snap_base rados 2023-01-24T21:41:53.500 INFO:tasks.workunit.client.0.smithi007.stderr:enabled application 'rados' on pool 'snap_base' 2023-01-24T21:41:53.513 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:436: test_tiering_2: ceph osd pool create snap_cache 2 2023-01-24T21:41:54.632 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'snap_cache' already exists 2023-01-24T21:41:54.641 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:437: test_tiering_2: ceph osd pool mksnap snap_cache snapname 2023-01-24T21:41:55.634 INFO:tasks.workunit.client.0.smithi007.stderr:pool snap_cache snap snapname already exists 2023-01-24T21:41:55.644 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:438: test_tiering_2: expect_false ceph osd tier add snap_base snap_cache 2023-01-24T21:41:55.644 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:35: expect_false: set -x 2023-01-24T21:41:55.645 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: ceph osd tier add snap_base snap_cache 2023-01-24T21:41:55.959 INFO:tasks.workunit.client.0.smithi007.stderr:Error ENOTEMPTY: tier pool 'snap_cache' has snapshot state; it cannot be added as a tier without breaking the pool 2023-01-24T21:41:55.961 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: return 0 2023-01-24T21:41:55.961 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:439: test_tiering_2: ceph osd pool delete snap_base snap_base --yes-i-really-really-mean-it 2023-01-24T21:41:56.636 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'snap_base' does not exist 2023-01-24T21:41:56.645 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:440: test_tiering_2: ceph osd pool delete snap_cache snap_cache --yes-i-really-really-mean-it 2023-01-24T21:41:57.643 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'snap_cache' does not exist 2023-01-24T21:41:57.652 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2973: main: set +x 2023-01-24T21:41:58.079 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2972: main: test_tiering_3 2023-01-24T21:41:58.079 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:446: test_tiering_3: ceph osd pool create basex 2 2023-01-24T21:41:58.643 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'basex' already exists 2023-01-24T21:41:58.651 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:447: test_tiering_3: ceph osd pool application enable basex rados 2023-01-24T21:42:00.524 INFO:tasks.workunit.client.0.smithi007.stderr:enabled application 'rados' on pool 'basex' 2023-01-24T21:42:00.536 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:448: test_tiering_3: ceph osd pool create cachex 2 2023-01-24T21:42:01.656 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cachex' already exists 2023-01-24T21:42:01.665 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:449: test_tiering_3: ceph osd tier add basex cachex 2023-01-24T21:42:02.679 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cachex' is now (or already was) a tier of 'basex' 2023-01-24T21:42:02.689 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:450: test_tiering_3: expect_false ceph osd pool mksnap cache snapname 2023-01-24T21:42:02.689 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:35: expect_false: set -x 2023-01-24T21:42:02.690 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: ceph osd pool mksnap cache snapname 2023-01-24T21:42:02.984 INFO:tasks.workunit.client.0.smithi007.stderr:Error ENOENT: unrecognized pool 'cache' 2023-01-24T21:42:02.985 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: return 0 2023-01-24T21:42:02.986 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:451: test_tiering_3: ceph osd tier remove basex cachex 2023-01-24T21:42:03.684 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cachex' is now (or already was) not a tier of 'basex' 2023-01-24T21:42:03.694 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:452: test_tiering_3: ceph osd pool delete basex basex --yes-i-really-really-mean-it 2023-01-24T21:42:04.673 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'basex' does not exist 2023-01-24T21:42:04.682 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:453: test_tiering_3: ceph osd pool delete cachex cachex --yes-i-really-really-mean-it 2023-01-24T21:42:05.678 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cachex' does not exist 2023-01-24T21:42:05.687 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2973: main: set +x 2023-01-24T21:42:06.120 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2972: main: test_tiering_4 2023-01-24T21:42:06.120 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:459: test_tiering_4: ceph osd pool create eccache 2 2 erasure 2023-01-24T21:42:07.687 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'eccache' already exists 2023-01-24T21:42:07.697 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:460: test_tiering_4: expect_false ceph osd set-require-min-compat-client bobtail 2023-01-24T21:42:07.697 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:35: expect_false: set -x 2023-01-24T21:42:07.697 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: ceph osd set-require-min-compat-client bobtail 2023-01-24T21:42:08.003 INFO:tasks.workunit.client.0.smithi007.stderr:Error EPERM: osdmap current utilizes features that require jewel; cannot set require_min_compat_client below that to bobtail 2023-01-24T21:42:08.005 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: return 0 2023-01-24T21:42:08.005 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:461: test_tiering_4: ceph osd pool create repbase 2 2023-01-24T21:42:08.684 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'repbase' already exists 2023-01-24T21:42:08.693 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:462: test_tiering_4: ceph osd pool application enable repbase rados 2023-01-24T21:42:10.566 INFO:tasks.workunit.client.0.smithi007.stderr:enabled application 'rados' on pool 'repbase' 2023-01-24T21:42:10.578 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:463: test_tiering_4: expect_false ceph osd tier add repbase eccache 2023-01-24T21:42:10.578 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:35: expect_false: set -x 2023-01-24T21:42:10.578 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: ceph osd tier add repbase eccache 2023-01-24T21:42:10.900 INFO:tasks.workunit.client.0.smithi007.stderr:Error ENOTSUP: tier pool 'eccache' is an ec pool, which cannot be a tier 2023-01-24T21:42:10.901 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: return 0 2023-01-24T21:42:10.902 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:464: test_tiering_4: ceph osd pool delete repbase repbase --yes-i-really-really-mean-it 2023-01-24T21:42:11.697 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'repbase' does not exist 2023-01-24T21:42:11.706 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:465: test_tiering_4: ceph osd pool delete eccache eccache --yes-i-really-really-mean-it 2023-01-24T21:42:12.704 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'eccache' does not exist 2023-01-24T21:42:12.714 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2973: main: set +x 2023-01-24T21:42:13.144 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2972: main: test_tiering_5 2023-01-24T21:42:13.145 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:471: test_tiering_5: ceph osd pool create slow 2 2023-01-24T21:42:13.704 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'slow' already exists 2023-01-24T21:42:13.713 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:472: test_tiering_5: ceph osd pool application enable slow rados 2023-01-24T21:42:15.588 INFO:tasks.workunit.client.0.smithi007.stderr:enabled application 'rados' on pool 'slow' 2023-01-24T21:42:15.600 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:473: test_tiering_5: ceph osd pool create cache3 2 2023-01-24T21:42:16.718 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cache3' already exists 2023-01-24T21:42:16.762 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:474: test_tiering_5: ceph osd tier add-cache slow cache3 1024000 2023-01-24T21:42:17.750 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cache3' is now (or already was) a tier of 'slow' 2023-01-24T21:42:17.760 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:475: test_tiering_5: ceph osd dump 2023-01-24T21:42:17.760 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:475: test_tiering_5: grep cache3 2023-01-24T21:42:17.760 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:475: test_tiering_5: grep bloom 2023-01-24T21:42:17.760 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:475: test_tiering_5: grep 'false_positive_probability: 0.05' 2023-01-24T21:42:17.761 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:475: test_tiering_5: grep 'target_bytes 1024000' 2023-01-24T21:42:17.761 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:475: test_tiering_5: grep '1200s x4' 2023-01-24T21:42:18.188 INFO:tasks.workunit.client.0.smithi007.stdout:pool 14 'cache3' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 2 pgp_num 2 autoscale_mode off last_change 79 lfor 79/79/79 flags hashpspool,creating tier_of 13 cache_mode writeback target_bytes 1024000 hit_set bloom{false_positive_probability: 0.05, target_size: 0, seed: 0} 1200s x4 decay_rate 20 search_last_n 1 min_read_recency_for_promote 1 min_write_recency_for_promote 1 stripe_width 0 application rados 2023-01-24T21:42:18.189 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:476: test_tiering_5: ceph osd tier remove slow cache3 2023-01-24T21:42:18.507 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:476: test_tiering_5: true 2023-01-24T21:42:18.508 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:477: test_tiering_5: check_response 'EBUSY: tier pool '\''cache3'\'' is the overlay for '\''slow'\''; please remove-overlay first' 2023-01-24T21:42:18.508 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:103: check_response: expected_string='EBUSY: tier pool '\''cache3'\'' is the overlay for '\''slow'\''; please remove-overlay first' 2023-01-24T21:42:18.509 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:104: check_response: retcode= 2023-01-24T21:42:18.509 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:105: check_response: expected_retcode= 2023-01-24T21:42:18.510 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:106: check_response: '[' '' -a '!=' ']' 2023-01-24T21:42:18.510 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:111: check_response: grep --quiet -- 'EBUSY: tier pool '\''cache3'\'' is the overlay for '\''slow'\''; please remove-overlay first' /tmp/cephtool.5YU/test_invalid.fWm 2023-01-24T21:42:18.510 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:478: test_tiering_5: ceph osd tier remove-overlay slow 2023-01-24T21:42:19.754 INFO:tasks.workunit.client.0.smithi007.stderr:there is now (or already was) no overlay for 'slow' 2023-01-24T21:42:19.763 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:479: test_tiering_5: ceph osd tier remove slow cache3 2023-01-24T21:42:20.754 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cache3' is now (or already was) not a tier of 'slow' 2023-01-24T21:42:20.764 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:480: test_tiering_5: ceph osd pool ls 2023-01-24T21:42:20.764 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:480: test_tiering_5: grep cache3 2023-01-24T21:42:21.194 INFO:tasks.workunit.client.0.smithi007.stdout:cache3 2023-01-24T21:42:21.194 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:481: test_tiering_5: ceph osd pool delete cache3 cache3 --yes-i-really-really-mean-it 2023-01-24T21:42:21.739 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cache3' does not exist 2023-01-24T21:42:21.749 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:482: test_tiering_5: ceph osd pool ls 2023-01-24T21:42:21.749 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:482: test_tiering_5: grep cache3 2023-01-24T21:42:22.175 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:483: test_tiering_5: ceph osd pool delete slow slow --yes-i-really-really-mean-it 2023-01-24T21:42:22.738 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'slow' does not exist 2023-01-24T21:42:22.747 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2973: main: set +x 2023-01-24T21:42:23.173 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2972: main: test_tiering_6 2023-01-24T21:42:23.173 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:489: test_tiering_6: ceph osd pool create datapool 2 2023-01-24T21:42:23.744 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'datapool' already exists 2023-01-24T21:42:23.754 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:490: test_tiering_6: ceph osd pool application enable datapool rados 2023-01-24T21:42:25.629 INFO:tasks.workunit.client.0.smithi007.stderr:enabled application 'rados' on pool 'datapool' 2023-01-24T21:42:25.641 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:491: test_tiering_6: ceph osd pool create cachepool 2 2023-01-24T21:42:26.759 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cachepool' already exists 2023-01-24T21:42:26.769 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:492: test_tiering_6: ceph osd tier add-cache datapool cachepool 1024000 2023-01-24T21:42:27.782 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cachepool' is now (or already was) a tier of 'datapool' 2023-01-24T21:42:27.792 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:493: test_tiering_6: ceph osd tier cache-mode cachepool writeback 2023-01-24T21:42:28.253 INFO:tasks.workunit.client.0.smithi007.stderr:set cache-mode for pool 'cachepool' to writeback 2023-01-24T21:42:28.263 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:494: test_tiering_6: rados -p datapool put object /etc/passwd 2023-01-24T21:42:28.294 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:495: test_tiering_6: rados -p cachepool stat object 2023-01-24T21:42:28.321 INFO:tasks.workunit.client.0.smithi007.stdout:cachepool/object mtime 2023-01-24T21:42:28.000000+0000, size 10247 2023-01-24T21:42:28.322 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:496: test_tiering_6: rados -p cachepool cache-flush object 2023-01-24T21:42:28.351 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:497: test_tiering_6: rados -p datapool stat object 2023-01-24T21:42:28.377 INFO:tasks.workunit.client.0.smithi007.stdout:datapool/object mtime 2023-01-24T21:42:28.000000+0000, size 10247 2023-01-24T21:42:28.379 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:498: test_tiering_6: ceph osd tier remove-overlay datapool 2023-01-24T21:42:29.791 INFO:tasks.workunit.client.0.smithi007.stderr:there is now (or already was) no overlay for 'datapool' 2023-01-24T21:42:29.801 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:499: test_tiering_6: ceph osd tier remove datapool cachepool 2023-01-24T21:42:30.795 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cachepool' is now (or already was) not a tier of 'datapool' 2023-01-24T21:42:30.804 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:500: test_tiering_6: ceph osd pool delete cachepool cachepool --yes-i-really-really-mean-it 2023-01-24T21:42:31.779 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cachepool' does not exist 2023-01-24T21:42:31.788 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:501: test_tiering_6: ceph osd pool delete datapool datapool --yes-i-really-really-mean-it 2023-01-24T21:42:32.784 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'datapool' does not exist 2023-01-24T21:42:32.794 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2973: main: set +x 2023-01-24T21:42:33.225 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2972: main: test_tiering_7 2023-01-24T21:42:33.225 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:507: test_tiering_7: ceph osd pool create datapool 2 2023-01-24T21:42:33.789 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'datapool' already exists 2023-01-24T21:42:33.799 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:508: test_tiering_7: ceph osd pool application enable datapool rados 2023-01-24T21:42:35.673 INFO:tasks.workunit.client.0.smithi007.stderr:enabled application 'rados' on pool 'datapool' 2023-01-24T21:42:35.685 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:509: test_tiering_7: ceph osd pool create cachepool 2 2023-01-24T21:42:36.806 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cachepool' already exists 2023-01-24T21:42:36.818 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:510: test_tiering_7: ceph osd tier add-cache datapool cachepool 1024000 2023-01-24T21:42:37.826 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cachepool' is now (or already was) a tier of 'datapool' 2023-01-24T21:42:37.835 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:511: test_tiering_7: ceph osd pool delete cachepool cachepool --yes-i-really-really-mean-it 2023-01-24T21:42:38.138 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:511: test_tiering_7: true 2023-01-24T21:42:38.138 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:512: test_tiering_7: check_response 'EBUSY: pool '\''cachepool'\'' is a tier of '\''datapool'\''' 2023-01-24T21:42:38.139 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:103: check_response: expected_string='EBUSY: pool '\''cachepool'\'' is a tier of '\''datapool'\''' 2023-01-24T21:42:38.139 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:104: check_response: retcode= 2023-01-24T21:42:38.139 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:105: check_response: expected_retcode= 2023-01-24T21:42:38.139 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:106: check_response: '[' '' -a '!=' ']' 2023-01-24T21:42:38.140 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:111: check_response: grep --quiet -- 'EBUSY: pool '\''cachepool'\'' is a tier of '\''datapool'\''' /tmp/cephtool.5YU/test_invalid.fWm 2023-01-24T21:42:38.140 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:513: test_tiering_7: ceph osd pool delete datapool datapool --yes-i-really-really-mean-it 2023-01-24T21:42:38.438 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:513: test_tiering_7: true 2023-01-24T21:42:38.438 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:514: test_tiering_7: check_response 'EBUSY: pool '\''datapool'\'' has tiers cachepool' 2023-01-24T21:42:38.438 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:103: check_response: expected_string='EBUSY: pool '\''datapool'\'' has tiers cachepool' 2023-01-24T21:42:38.438 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:104: check_response: retcode= 2023-01-24T21:42:38.439 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:105: check_response: expected_retcode= 2023-01-24T21:42:38.439 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:106: check_response: '[' '' -a '!=' ']' 2023-01-24T21:42:38.439 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:111: check_response: grep --quiet -- 'EBUSY: pool '\''datapool'\'' has tiers cachepool' /tmp/cephtool.5YU/test_invalid.fWm 2023-01-24T21:42:38.440 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:515: test_tiering_7: ceph osd tier remove-overlay datapool 2023-01-24T21:42:39.836 INFO:tasks.workunit.client.0.smithi007.stderr:there is now (or already was) no overlay for 'datapool' 2023-01-24T21:42:39.845 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:516: test_tiering_7: ceph osd tier remove datapool cachepool 2023-01-24T21:42:40.834 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cachepool' is now (or already was) not a tier of 'datapool' 2023-01-24T21:42:40.843 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:517: test_tiering_7: ceph osd pool delete cachepool cachepool --yes-i-really-really-mean-it 2023-01-24T21:42:41.825 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cachepool' does not exist 2023-01-24T21:42:41.834 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:518: test_tiering_7: ceph osd pool delete datapool datapool --yes-i-really-really-mean-it 2023-01-24T21:42:42.823 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'datapool' does not exist 2023-01-24T21:42:42.832 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2973: main: set +x 2023-01-24T21:42:43.262 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2972: main: test_tiering_8 2023-01-24T21:42:43.262 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:524: test_tiering_8: ceph osd set notieragent 2023-01-24T21:42:44.708 INFO:tasks.workunit.client.0.smithi007.stderr:notieragent is set 2023-01-24T21:42:44.720 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:525: test_tiering_8: ceph osd pool create datapool 2 2023-01-24T21:42:45.839 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'datapool' already exists 2023-01-24T21:42:45.849 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:526: test_tiering_8: ceph osd pool application enable datapool rados 2023-01-24T21:42:47.720 INFO:tasks.workunit.client.0.smithi007.stderr:enabled application 'rados' on pool 'datapool' 2023-01-24T21:42:47.732 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:527: test_tiering_8: ceph osd pool create cache4 2 2023-01-24T21:42:48.852 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cache4' already exists 2023-01-24T21:42:48.861 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:528: test_tiering_8: ceph osd tier add-cache datapool cache4 1024000 2023-01-24T21:42:49.874 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cache4' is now (or already was) a tier of 'datapool' 2023-01-24T21:42:49.884 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:529: test_tiering_8: ceph osd tier cache-mode cache4 writeback 2023-01-24T21:42:50.341 INFO:tasks.workunit.client.0.smithi007.stderr:set cache-mode for pool 'cache4' to writeback 2023-01-24T21:42:50.352 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:530: test_tiering_8: mktemp 2023-01-24T21:42:50.352 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:530: test_tiering_8: grep tmp 2023-01-24T21:42:50.353 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:530: test_tiering_8: tmpfile=/tmp/tmp.uaPij0Zqzw 2023-01-24T21:42:50.353 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:531: test_tiering_8: dd if=/dev/zero of=/tmp/tmp.uaPij0Zqzw bs=4K count=1 2023-01-24T21:42:50.354 INFO:tasks.workunit.client.0.smithi007.stderr:1+0 records in 2023-01-24T21:42:50.354 INFO:tasks.workunit.client.0.smithi007.stderr:1+0 records out 2023-01-24T21:42:50.354 INFO:tasks.workunit.client.0.smithi007.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 8.5167e-05 s, 48.1 MB/s 2023-01-24T21:42:50.354 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:532: test_tiering_8: ceph osd pool set cache4 target_max_objects 200 2023-01-24T21:42:51.737 INFO:tasks.workunit.client.0.smithi007.stderr:set pool 20 target_max_objects to 200 2023-01-24T21:42:51.750 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:533: test_tiering_8: ceph osd pool set cache4 target_max_bytes 1000000 2023-01-24T21:42:53.746 INFO:tasks.workunit.client.0.smithi007.stderr:set pool 20 target_max_bytes to 1000000 2023-01-24T21:42:53.758 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:534: test_tiering_8: rados -p cache4 put foo1 /tmp/tmp.uaPij0Zqzw 2023-01-24T21:42:53.791 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:535: test_tiering_8: rados -p cache4 put foo2 /tmp/tmp.uaPij0Zqzw 2023-01-24T21:42:53.824 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:536: test_tiering_8: rm -f /tmp/tmp.uaPij0Zqzw 2023-01-24T21:42:53.825 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:537: test_tiering_8: flush_pg_stats 2023-01-24T21:42:53.825 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2127: flush_pg_stats: local timeout=300 2023-01-24T21:42:53.826 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2129: flush_pg_stats: ceph osd ls 2023-01-24T21:42:54.257 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2129: flush_pg_stats: ids='0 2023-01-24T21:42:54.258 INFO:tasks.workunit.client.0.smithi007.stderr:1 2023-01-24T21:42:54.258 INFO:tasks.workunit.client.0.smithi007.stderr:2' 2023-01-24T21:42:54.258 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2130: flush_pg_stats: seqs= 2023-01-24T21:42:54.258 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2131: flush_pg_stats: for osd in $ids 2023-01-24T21:42:54.258 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2132: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2023-01-24T21:42:54.396 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2132: flush_pg_stats: seq=34359738411 2023-01-24T21:42:54.396 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2133: flush_pg_stats: test -z 34359738411 2023-01-24T21:42:54.397 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2137: flush_pg_stats: seqs=' 0-34359738411' 2023-01-24T21:42:54.397 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2131: flush_pg_stats: for osd in $ids 2023-01-24T21:42:54.397 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2132: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2023-01-24T21:42:54.537 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2132: flush_pg_stats: seq=34359738412 2023-01-24T21:42:54.537 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2133: flush_pg_stats: test -z 34359738412 2023-01-24T21:42:54.537 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2137: flush_pg_stats: seqs=' 0-34359738411 1-34359738412' 2023-01-24T21:42:54.538 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2131: flush_pg_stats: for osd in $ids 2023-01-24T21:42:54.538 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2132: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2023-01-24T21:42:54.677 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2132: flush_pg_stats: seq=34359738413 2023-01-24T21:42:54.677 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2133: flush_pg_stats: test -z 34359738413 2023-01-24T21:42:54.677 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2137: flush_pg_stats: seqs=' 0-34359738411 1-34359738412 2-34359738413' 2023-01-24T21:42:54.677 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2140: flush_pg_stats: for s in $seqs 2023-01-24T21:42:54.677 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2141: flush_pg_stats: echo 0-34359738411 2023-01-24T21:42:54.678 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2141: flush_pg_stats: cut -d - -f 1 2023-01-24T21:42:54.678 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2141: flush_pg_stats: osd=0 2023-01-24T21:42:54.678 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2142: flush_pg_stats: echo 0-34359738411 2023-01-24T21:42:54.679 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2142: flush_pg_stats: cut -d - -f 2 2023-01-24T21:42:54.679 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2142: flush_pg_stats: seq=34359738411 2023-01-24T21:42:54.680 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2143: flush_pg_stats: echo 'waiting osd.0 seq 34359738411' 2023-01-24T21:42:54.680 INFO:tasks.workunit.client.0.smithi007.stdout:waiting osd.0 seq 34359738411 2023-01-24T21:42:54.680 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2144: flush_pg_stats: ceph osd last-stat-seq 0 2023-01-24T21:42:55.112 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2144: flush_pg_stats: test 34359738409 -lt 34359738411 2023-01-24T21:42:55.113 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2145: flush_pg_stats: sleep 1 2023-01-24T21:42:56.113 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2146: flush_pg_stats: '[' 300 -eq 0 ']' 2023-01-24T21:42:56.114 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2144: flush_pg_stats: ceph osd last-stat-seq 0 2023-01-24T21:42:56.554 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2144: flush_pg_stats: test 34359738412 -lt 34359738411 2023-01-24T21:42:56.554 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2140: flush_pg_stats: for s in $seqs 2023-01-24T21:42:56.555 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2141: flush_pg_stats: echo 1-34359738412 2023-01-24T21:42:56.555 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2141: flush_pg_stats: cut -d - -f 1 2023-01-24T21:42:56.555 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2141: flush_pg_stats: osd=1 2023-01-24T21:42:56.556 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2142: flush_pg_stats: echo 1-34359738412 2023-01-24T21:42:56.556 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2142: flush_pg_stats: cut -d - -f 2 2023-01-24T21:42:56.557 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2142: flush_pg_stats: seq=34359738412 2023-01-24T21:42:56.557 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2143: flush_pg_stats: echo 'waiting osd.1 seq 34359738412' 2023-01-24T21:42:56.558 INFO:tasks.workunit.client.0.smithi007.stdout:waiting osd.1 seq 34359738412 2023-01-24T21:42:56.558 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2144: flush_pg_stats: ceph osd last-stat-seq 1 2023-01-24T21:42:56.985 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2144: flush_pg_stats: test 34359738412 -lt 34359738412 2023-01-24T21:42:56.985 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2140: flush_pg_stats: for s in $seqs 2023-01-24T21:42:56.986 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2141: flush_pg_stats: echo 2-34359738413 2023-01-24T21:42:56.986 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2141: flush_pg_stats: cut -d - -f 1 2023-01-24T21:42:56.987 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2141: flush_pg_stats: osd=2 2023-01-24T21:42:56.987 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2142: flush_pg_stats: echo 2-34359738413 2023-01-24T21:42:56.987 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2142: flush_pg_stats: cut -d - -f 2 2023-01-24T21:42:56.988 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2142: flush_pg_stats: seq=34359738413 2023-01-24T21:42:56.988 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2143: flush_pg_stats: echo 'waiting osd.2 seq 34359738413' 2023-01-24T21:42:56.989 INFO:tasks.workunit.client.0.smithi007.stdout:waiting osd.2 seq 34359738413 2023-01-24T21:42:56.989 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2144: flush_pg_stats: ceph osd last-stat-seq 2 2023-01-24T21:42:57.421 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh:2144: flush_pg_stats: test 34359738413 -lt 34359738413 2023-01-24T21:42:57.421 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:538: test_tiering_8: ceph df 2023-01-24T21:42:57.421 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:538: test_tiering_8: grep datapool 2023-01-24T21:42:57.421 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:538: test_tiering_8: grep ' 2 ' 2023-01-24T21:42:58.000 INFO:tasks.workunit.client.0.smithi007.stdout:datapool 19 2 0 B 2 0 B 0 128 GiB 2023-01-24T21:42:58.000 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:539: test_tiering_8: ceph osd tier remove-overlay datapool 2023-01-24T21:42:58.900 INFO:tasks.workunit.client.0.smithi007.stderr:there is now (or already was) no overlay for 'datapool' 2023-01-24T21:42:58.909 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:540: test_tiering_8: ceph osd tier remove datapool cache4 2023-01-24T21:42:59.900 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cache4' is now (or already was) not a tier of 'datapool' 2023-01-24T21:42:59.910 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:541: test_tiering_8: ceph osd pool delete cache4 cache4 --yes-i-really-really-mean-it 2023-01-24T21:43:00.887 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cache4' does not exist 2023-01-24T21:43:00.897 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:542: test_tiering_8: ceph osd pool delete datapool datapool --yes-i-really-really-mean-it 2023-01-24T21:43:01.892 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'datapool' does not exist 2023-01-24T21:43:01.902 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:543: test_tiering_8: ceph osd unset notieragent 2023-01-24T21:43:03.778 INFO:tasks.workunit.client.0.smithi007.stderr:notieragent is unset 2023-01-24T21:43:03.790 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2973: main: set +x 2023-01-24T21:43:04.224 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2972: main: test_tiering_9 2023-01-24T21:43:04.225 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:552: test_tiering_9: ceph osd pool create basepoolA 2 2023-01-24T21:43:04.903 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'basepoolA' already exists 2023-01-24T21:43:04.913 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:553: test_tiering_9: ceph osd pool application enable basepoolA rados 2023-01-24T21:43:06.787 INFO:tasks.workunit.client.0.smithi007.stderr:enabled application 'rados' on pool 'basepoolA' 2023-01-24T21:43:06.799 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:554: test_tiering_9: ceph osd pool create basepoolB 2 2023-01-24T21:43:07.919 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'basepoolB' already exists 2023-01-24T21:43:07.929 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:555: test_tiering_9: ceph osd pool application enable basepoolB rados 2023-01-24T21:43:09.804 INFO:tasks.workunit.client.0.smithi007.stderr:enabled application 'rados' on pool 'basepoolB' 2023-01-24T21:43:09.815 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:556: test_tiering_9: ceph osd dump 2023-01-24T21:43:09.816 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:556: test_tiering_9: grep 'pool.*basepoolA' 2023-01-24T21:43:09.816 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:556: test_tiering_9: awk '{print $2;}' 2023-01-24T21:43:10.249 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:556: test_tiering_9: poolA_id=21 2023-01-24T21:43:10.249 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:557: test_tiering_9: ceph osd dump 2023-01-24T21:43:10.250 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:557: test_tiering_9: grep 'pool.*basepoolB' 2023-01-24T21:43:10.250 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:557: test_tiering_9: awk '{print $2;}' 2023-01-24T21:43:10.680 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:557: test_tiering_9: poolB_id=22 2023-01-24T21:43:10.680 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:559: test_tiering_9: ceph osd pool create cache5 2 2023-01-24T21:43:11.939 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cache5' already exists 2023-01-24T21:43:11.949 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:560: test_tiering_9: ceph osd pool create cache6 2 2023-01-24T21:43:12.938 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cache6' already exists 2023-01-24T21:43:12.948 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:561: test_tiering_9: ceph osd tier add basepoolA cache5 2023-01-24T21:43:13.966 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cache5' is now (or already was) a tier of 'basepoolA' 2023-01-24T21:43:13.975 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:562: test_tiering_9: ceph osd tier add basepoolB cache6 2023-01-24T21:43:14.964 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cache6' is now (or already was) a tier of 'basepoolB' 2023-01-24T21:43:14.974 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:563: test_tiering_9: ceph osd tier remove basepoolB cache5 2023-01-24T21:43:14.975 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:563: test_tiering_9: grep 'not a tier of' 2023-01-24T21:43:15.443 INFO:tasks.workunit.client.0.smithi007.stdout:pool 'cache5' is now (or already was) not a tier of 'basepoolB' 2023-01-24T21:43:15.444 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:564: test_tiering_9: ceph osd dump 2023-01-24T21:43:15.444 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:564: test_tiering_9: grep 'pool.*'\''cache5'\''' 2023-01-24T21:43:15.444 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:564: test_tiering_9: grep 'tier_of[ \t]\+21' 2023-01-24T21:43:15.876 INFO:tasks.workunit.client.0.smithi007.stdout:pool 23 'cache5' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 2 pgp_num 2 autoscale_mode off last_change 130 flags hashpspool tier_of 21 stripe_width 0 application rados 2023-01-24T21:43:15.876 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:565: test_tiering_9: ceph osd tier remove basepoolA cache6 2023-01-24T21:43:15.877 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:565: test_tiering_9: grep 'not a tier of' 2023-01-24T21:43:16.346 INFO:tasks.workunit.client.0.smithi007.stdout:pool 'cache6' is now (or already was) not a tier of 'basepoolA' 2023-01-24T21:43:16.347 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:566: test_tiering_9: ceph osd dump 2023-01-24T21:43:16.347 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:566: test_tiering_9: grep 'pool.*'\''cache6'\''' 2023-01-24T21:43:16.348 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:566: test_tiering_9: grep 'tier_of[ \t]\+22' 2023-01-24T21:43:16.775 INFO:tasks.workunit.client.0.smithi007.stdout:pool 24 'cache6' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 2 pgp_num 2 autoscale_mode off last_change 131 flags hashpspool tier_of 22 stripe_width 0 application rados 2023-01-24T21:43:16.776 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:568: test_tiering_9: ceph osd tier remove basepoolA cache5 2023-01-24T21:43:16.776 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:568: test_tiering_9: grep 'not a tier of' 2023-01-24T21:43:17.984 INFO:tasks.workunit.client.0.smithi007.stdout:pool 'cache5' is now (or already was) not a tier of 'basepoolA' 2023-01-24T21:43:17.985 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:569: test_tiering_9: ceph osd dump 2023-01-24T21:43:17.985 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:569: test_tiering_9: grep 'pool.*'\''cache5'\''' 2023-01-24T21:43:17.985 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:569: test_tiering_9: grep tier_of 2023-01-24T21:43:18.414 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:570: test_tiering_9: ceph osd tier remove basepoolB cache6 2023-01-24T21:43:18.414 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:570: test_tiering_9: grep 'not a tier of' 2023-01-24T21:43:18.985 INFO:tasks.workunit.client.0.smithi007.stdout:pool 'cache6' is now (or already was) not a tier of 'basepoolB' 2023-01-24T21:43:18.986 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:571: test_tiering_9: ceph osd dump 2023-01-24T21:43:18.986 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:571: test_tiering_9: grep 'pool.*'\''cache6'\''' 2023-01-24T21:43:18.987 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:571: test_tiering_9: grep tier_of 2023-01-24T21:43:19.412 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:573: test_tiering_9: ceph osd dump 2023-01-24T21:43:19.412 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:573: test_tiering_9: grep 'pool.*'\''basepoolA'\''' 2023-01-24T21:43:19.413 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:573: test_tiering_9: grep tiers 2023-01-24T21:43:19.841 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:574: test_tiering_9: ceph osd dump 2023-01-24T21:43:19.842 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:574: test_tiering_9: grep 'pool.*'\''basepoolB'\''' 2023-01-24T21:43:19.842 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:574: test_tiering_9: grep tiers 2023-01-24T21:43:20.271 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:576: test_tiering_9: ceph osd pool delete cache6 cache6 --yes-i-really-really-mean-it 2023-01-24T21:43:21.595 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cache6' does not exist 2023-01-24T21:43:21.605 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:577: test_tiering_9: ceph osd pool delete cache5 cache5 --yes-i-really-really-mean-it 2023-01-24T21:43:22.972 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'cache5' does not exist 2023-01-24T21:43:22.982 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:578: test_tiering_9: ceph osd pool delete basepoolB basepoolB --yes-i-really-really-mean-it 2023-01-24T21:43:23.972 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'basepoolB' does not exist 2023-01-24T21:43:23.981 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:579: test_tiering_9: ceph osd pool delete basepoolA basepoolA --yes-i-really-really-mean-it 2023-01-24T21:43:24.975 INFO:tasks.workunit.client.0.smithi007.stderr:pool 'basepoolA' does not exist 2023-01-24T21:43:24.985 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2973: main: set +x 2023-01-24T21:43:25.412 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2972: main: test_auth 2023-01-24T21:43:25.413 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:584: test_auth: expect_false ceph auth add client.xx mon invalid osd 'allow *' 2023-01-24T21:43:25.413 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:35: expect_false: set -x 2023-01-24T21:43:25.413 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: ceph auth add client.xx mon invalid osd 'allow *' 2023-01-24T21:43:25.786 INFO:tasks.workunit.client.0.smithi007.stderr:Error EINVAL: mon capability parse failed, stopped at 'invalid' of 'invalid' 2023-01-24T21:43:25.788 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: return 0 2023-01-24T21:43:25.788 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:585: test_auth: expect_false ceph auth add client.xx mon 'allow *' osd 'allow *' invalid 'allow *' 2023-01-24T21:43:25.788 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:35: expect_false: set -x 2023-01-24T21:43:25.788 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: ceph auth add client.xx mon 'allow *' osd 'allow *' invalid 'allow *' 2023-01-24T21:43:26.167 INFO:tasks.workunit.client.0.smithi007.stderr:Error EINVAL: unknown cap type 'invalid' 2023-01-24T21:43:26.168 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: return 0 2023-01-24T21:43:26.169 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:586: test_auth: ceph auth add client.xx mon 'allow *' osd 'allow *' 2023-01-24T21:43:26.751 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:587: test_auth: ceph auth export client.xx 2023-01-24T21:43:27.334 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:588: test_auth: ceph auth add client.xx -i client.xx.keyring 2023-01-24T21:43:27.912 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:589: test_auth: rm -f client.xx.keyring 2023-01-24T21:43:27.912 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:590: test_auth: ceph auth list 2023-01-24T21:43:27.913 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:590: test_auth: grep client.xx 2023-01-24T21:43:28.497 INFO:tasks.workunit.client.0.smithi007.stdout:client.xx 2023-01-24T21:43:28.497 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:591: test_auth: ceph auth ls 2023-01-24T21:43:28.498 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:591: test_auth: grep client.xx 2023-01-24T21:43:29.076 INFO:tasks.workunit.client.0.smithi007.stdout:client.xx 2023-01-24T21:43:29.077 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:592: test_auth: ceph auth get client.xx 2023-01-24T21:43:29.077 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:592: test_auth: grep caps 2023-01-24T21:43:29.077 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:592: test_auth: grep mon 2023-01-24T21:43:29.656 INFO:tasks.workunit.client.0.smithi007.stdout: caps mon = "allow *" 2023-01-24T21:43:29.657 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:593: test_auth: ceph auth get client.xx 2023-01-24T21:43:29.657 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:593: test_auth: grep caps 2023-01-24T21:43:29.657 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:593: test_auth: grep osd 2023-01-24T21:43:30.240 INFO:tasks.workunit.client.0.smithi007.stdout: caps osd = "allow *" 2023-01-24T21:43:30.240 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:594: test_auth: ceph auth get-key client.xx 2023-01-24T21:43:30.816 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:595: test_auth: ceph auth print-key client.xx 2023-01-24T21:43:31.396 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:596: test_auth: ceph auth print_key client.xx 2023-01-24T21:43:31.974 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:597: test_auth: ceph auth caps client.xx osd 'allow rw' 2023-01-24T21:43:32.546 INFO:tasks.workunit.client.0.smithi007.stderr:updated caps for client.xx 2023-01-24T21:43:32.555 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:598: test_auth: expect_false sh 2023-01-24T21:43:32.556 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:35: expect_false: set -x 2023-01-24T21:43:32.556 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: sh 2023-01-24T21:43:33.128 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: return 0 2023-01-24T21:43:33.128 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:599: test_auth: ceph auth get client.xx 2023-01-24T21:43:33.129 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:599: test_auth: grep osd 2023-01-24T21:43:33.129 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:599: test_auth: grep 'allow rw' 2023-01-24T21:43:33.702 INFO:tasks.workunit.client.0.smithi007.stdout:AQD+UNBjVF8pIBAArjxdhWhotnKRkmSxIyQUDQ==AQD+UNBjVF8pIBAArjxdhWhotnKRkmSxIyQUDQ==AQD+UNBjVF8pIBAArjxdhWhotnKRkmSxIyQUDQ== caps osd = "allow rw" 2023-01-24T21:43:33.702 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:600: test_auth: ceph auth caps client.xx mon 'allow command "osd tree"' 2023-01-24T21:43:34.278 INFO:tasks.workunit.client.0.smithi007.stderr:updated caps for client.xx 2023-01-24T21:43:34.288 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:601: test_auth: ceph auth export 2023-01-24T21:43:34.288 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:601: test_auth: grep client.xx 2023-01-24T21:43:34.864 INFO:tasks.workunit.client.0.smithi007.stdout:[client.xx] 2023-01-24T21:43:34.864 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:602: test_auth: ceph auth export -o authfile 2023-01-24T21:43:35.436 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:603: test_auth: ceph auth import -i authfile 2023-01-24T21:43:36.025 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:605: test_auth: ceph auth export -o authfile2 2023-01-24T21:43:36.602 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:606: test_auth: diff authfile authfile2 2023-01-24T21:43:36.603 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:607: test_auth: rm authfile authfile2 2023-01-24T21:43:36.603 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:608: test_auth: ceph auth del client.xx 2023-01-24T21:43:37.185 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:609: test_auth: expect_false ceph auth get client.xx 2023-01-24T21:43:37.186 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:35: expect_false: set -x 2023-01-24T21:43:37.186 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: ceph auth get client.xx 2023-01-24T21:43:37.550 INFO:tasks.workunit.client.0.smithi007.stderr:Error ENOENT: failed to find client.xx in keyring 2023-01-24T21:43:37.552 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: return 0 2023-01-24T21:43:37.553 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:612: test_auth: echo -e 'auth add client.xx mon "allow *" osd "allow *"\n' 2023-01-24T21:43:37.553 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:612: test_auth: ceph 2023-01-24T21:43:37.923 INFO:tasks.workunit.client.0.smithi007.stderr:added key for client.xx 2023-01-24T21:43:37.932 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:613: test_auth: ceph auth get client.xx 2023-01-24T21:43:38.494 INFO:tasks.workunit.client.0.smithi007.stdout:[client.xx] 2023-01-24T21:43:38.494 INFO:tasks.workunit.client.0.smithi007.stdout: key = AQAJUdBj6221NhAAedDkLnOhiWWKKD2xGNDjGg== 2023-01-24T21:43:38.495 INFO:tasks.workunit.client.0.smithi007.stdout: caps mon = "allow *" 2023-01-24T21:43:38.495 INFO:tasks.workunit.client.0.smithi007.stdout: caps osd = "allow *" 2023-01-24T21:43:38.506 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:615: test_auth: echo 'auth del client.xx' 2023-01-24T21:43:38.506 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:615: test_auth: ceph 2023-01-24T21:43:38.888 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:616: test_auth: expect_false ceph auth get client.xx 2023-01-24T21:43:38.888 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:35: expect_false: set -x 2023-01-24T21:43:38.888 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: ceph auth get client.xx 2023-01-24T21:43:39.253 INFO:tasks.workunit.client.0.smithi007.stderr:Error ENOENT: failed to find client.xx in keyring 2023-01-24T21:43:39.255 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:36: expect_false: return 0 2023-01-24T21:43:39.255 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2973: main: set +x 2023-01-24T21:43:39.688 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2972: main: test_auth_profiles 2023-01-24T21:43:39.689 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:621: test_auth_profiles: ceph auth add client.xx-profile-ro mon 'allow profile read-only' mgr 'allow profile read-only' 2023-01-24T21:43:40.272 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:623: test_auth_profiles: ceph auth add client.xx-profile-rw mon 'allow profile read-write' mgr 'allow profile read-write' 2023-01-24T21:43:40.857 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:625: test_auth_profiles: ceph auth add client.xx-profile-rd mon 'allow profile role-definer' 2023-01-24T21:43:41.437 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:627: test_auth_profiles: ceph auth export 2023-01-24T21:43:42.011 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:630: test_auth_profiles: ceph -n client.xx-profile-ro -k client.xx.keyring status 2023-01-24T21:43:42.580 INFO:tasks.workunit.client.0.smithi007.stdout: cluster: 2023-01-24T21:43:42.581 INFO:tasks.workunit.client.0.smithi007.stdout: id: a59d83ed-89b8-47a3-be21-f6c4b4e37305 2023-01-24T21:43:42.581 INFO:tasks.workunit.client.0.smithi007.stdout: health: HEALTH_OK 2023-01-24T21:43:42.581 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-24T21:43:42.581 INFO:tasks.workunit.client.0.smithi007.stdout: services: 2023-01-24T21:43:42.582 INFO:tasks.workunit.client.0.smithi007.stdout: mon: 3 daemons, quorum a,b,c (age 3m) 2023-01-24T21:43:42.582 INFO:tasks.workunit.client.0.smithi007.stdout: mgr: x(active, since 3m) 2023-01-24T21:43:42.582 INFO:tasks.workunit.client.0.smithi007.stdout: osd: 3 osds: 3 up (since 3m), 3 in (since 3m) 2023-01-24T21:43:42.582 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-24T21:43:42.582 INFO:tasks.workunit.client.0.smithi007.stdout: data: 2023-01-24T21:43:42.583 INFO:tasks.workunit.client.0.smithi007.stdout: pools: 2 pools, 9 pgs 2023-01-24T21:43:42.583 INFO:tasks.workunit.client.0.smithi007.stdout: objects: 2 objects, 577 KiB 2023-01-24T21:43:42.583 INFO:tasks.workunit.client.0.smithi007.stdout: usage: 23 MiB used, 270 GiB / 270 GiB avail 2023-01-24T21:43:42.583 INFO:tasks.workunit.client.0.smithi007.stdout: pgs: 9 active+clean 2023-01-24T21:43:42.583 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-24T21:43:42.592 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:631: test_auth_profiles: ceph -n client.xx-profile-ro -k client.xx.keyring osd dump 2023-01-24T21:43:43.008 INFO:tasks.workunit.client.0.smithi007.stdout:epoch 137 2023-01-24T21:43:43.009 INFO:tasks.workunit.client.0.smithi007.stdout:fsid a59d83ed-89b8-47a3-be21-f6c4b4e37305 2023-01-24T21:43:43.009 INFO:tasks.workunit.client.0.smithi007.stdout:created 2023-01-24T21:39:45.471377+0000 2023-01-24T21:43:43.009 INFO:tasks.workunit.client.0.smithi007.stdout:modified 2023-01-24T21:43:24.838735+0000 2023-01-24T21:43:43.009 INFO:tasks.workunit.client.0.smithi007.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-01-24T21:43:43.009 INFO:tasks.workunit.client.0.smithi007.stdout:crush_version 5 2023-01-24T21:43:43.010 INFO:tasks.workunit.client.0.smithi007.stdout:full_ratio 0.95 2023-01-24T21:43:43.010 INFO:tasks.workunit.client.0.smithi007.stdout:backfillfull_ratio 0.9 2023-01-24T21:43:43.010 INFO:tasks.workunit.client.0.smithi007.stdout:nearfull_ratio 0.85 2023-01-24T21:43:43.010 INFO:tasks.workunit.client.0.smithi007.stdout:require_min_compat_client luminous 2023-01-24T21:43:43.010 INFO:tasks.workunit.client.0.smithi007.stdout:min_compat_client jewel 2023-01-24T21:43:43.011 INFO:tasks.workunit.client.0.smithi007.stdout:require_osd_release quincy 2023-01-24T21:43:43.011 INFO:tasks.workunit.client.0.smithi007.stdout:stretch_mode_enabled false 2023-01-24T21:43:43.011 INFO:tasks.workunit.client.0.smithi007.stdout:pool 1 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 application rbd 2023-01-24T21:43:43.011 INFO:tasks.workunit.client.0.smithi007.stdout:pool 2 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 12 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr 2023-01-24T21:43:43.011 INFO:tasks.workunit.client.0.smithi007.stdout:max_osd 3 2023-01-24T21:43:43.012 INFO:tasks.workunit.client.0.smithi007.stdout:osd.0 up in weight 1 up_from 8 up_thru 128 down_at 0 last_clean_interval [0,0) v1:172.21.15.7:6802/81207 v1:172.21.15.7:6805/81207 exists,up 6d40d965-9a66-46d2-8758-d2034c9feb28 2023-01-24T21:43:43.012 INFO:tasks.workunit.client.0.smithi007.stdout:osd.1 up in weight 1 up_from 8 up_thru 129 down_at 0 last_clean_interval [0,0) v1:172.21.15.7:6800/81208 v1:172.21.15.7:6803/81208 exists,up 0fa19857-21e0-4c68-b4f7-58da09ad64fa 2023-01-24T21:43:43.012 INFO:tasks.workunit.client.0.smithi007.stdout:osd.2 up in weight 1 up_from 8 up_thru 128 down_at 0 last_clean_interval [0,0) v1:172.21.15.7:6801/81209 v1:172.21.15.7:6804/81209 exists,up a94607f3-c9bd-4b4d-8fb2-b1d8a06892c5 2023-01-24T21:43:43.020 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:632: test_auth_profiles: ceph -n client.xx-profile-ro -k client.xx.keyring pg dump 2023-01-24T21:43:43.427 INFO:tasks.workunit.client.0.smithi007.stdout:version 250 2023-01-24T21:43:43.428 INFO:tasks.workunit.client.0.smithi007.stdout:stamp 2023-01-24T21:43:43.100343+0000 2023-01-24T21:43:43.428 INFO:tasks.workunit.client.0.smithi007.stdout:last_osdmap_epoch 0 2023-01-24T21:43:43.428 INFO:tasks.workunit.client.0.smithi007.stdout:last_pg_scan 0 2023-01-24T21:43:43.428 INFO:tasks.workunit.client.0.smithi007.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2023-01-24T21:43:43.429 INFO:tasks.workunit.client.0.smithi007.stdout:1.5 0 0 0 0 0 0 0 0 0 0 active+clean 2023-01-24T21:39:55.461218+0000 0'0 136:123 [2,0] 2 [2,0] 2 0'0 2023-01-24T21:39:54.444353+0000 0'0 2023-01-24T21:39:54.444353+0000 0 0 periodic scrub scheduled @ 2023-01-26T01:39:36.790147+0000 0 0 2023-01-24T21:43:43.429 INFO:tasks.workunit.client.0.smithi007.stdout:1.4 0 0 0 0 0 0 0 0 0 0 active+clean 2023-01-24T21:39:55.458239+0000 0'0 136:130 [1,0] 1 [1,0] 1 0'0 2023-01-24T21:39:54.444353+0000 0'0 2023-01-24T21:39:54.444353+0000 0 0 periodic scrub scheduled @ 2023-01-26T05:04:42.428315+0000 0 0 2023-01-24T21:43:43.429 INFO:tasks.workunit.client.0.smithi007.stdout:1.3 0 0 0 0 0 0 0 0 0 0 active+clean 2023-01-24T21:39:55.459665+0000 0'0 136:130 [1,2] 1 [1,2] 1 0'0 2023-01-24T21:39:54.444353+0000 0'0 2023-01-24T21:39:54.444353+0000 0 0 periodic scrub scheduled @ 2023-01-26T02:01:21.924187+0000 0 0 2023-01-24T21:43:43.429 INFO:tasks.workunit.client.0.smithi007.stdout:2.0 2 0 0 0 0 590368 0 0 97 97 active+clean 2023-01-24T21:39:56.500335+0000 11'97 136:249 [2,1] 2 [2,1] 2 0'0 2023-01-24T21:39:55.447612+0000 0'0 2023-01-24T21:39:55.447612+0000 0 0 periodic scrub scheduled @ 2023-01-26T07:28:03.331300+0000 0 0 2023-01-24T21:43:43.430 INFO:tasks.workunit.client.0.smithi007.stdout:1.2 0 0 0 0 0 0 0 0 0 0 active+clean 2023-01-24T21:39:55.457395+0000 0'0 136:135 [0,1] 0 [0,1] 0 0'0 2023-01-24T21:39:54.444353+0000 0'0 2023-01-24T21:39:54.444353+0000 0 0 periodic scrub scheduled @ 2023-01-26T05:35:20.546509+0000 0 0 2023-01-24T21:43:43.430 INFO:tasks.workunit.client.0.smithi007.stdout:1.0 0 0 0 0 0 0 0 0 0 0 active+clean 2023-01-24T21:39:55.457028+0000 0'0 136:130 [1,0] 1 [1,0] 1 0'0 2023-01-24T21:39:54.444353+0000 0'0 2023-01-24T21:39:54.444353+0000 0 0 periodic scrub scheduled @ 2023-01-26T02:17:09.155039+0000 0 0 2023-01-24T21:43:43.430 INFO:tasks.workunit.client.0.smithi007.stdout:1.1 0 0 0 0 0 0 0 0 0 0 active+clean 2023-01-24T21:39:55.460163+0000 0'0 136:123 [2,0] 2 [2,0] 2 0'0 2023-01-24T21:39:54.444353+0000 0'0 2023-01-24T21:39:54.444353+0000 0 0 periodic scrub scheduled @ 2023-01-25T22:53:13.460426+0000 0 0 2023-01-24T21:43:43.430 INFO:tasks.workunit.client.0.smithi007.stdout:1.6 0 0 0 0 0 0 0 0 0 0 active+clean 2023-01-24T21:39:55.456301+0000 0'0 136:130 [1,0] 1 [1,0] 1 0'0 2023-01-24T21:39:54.444353+0000 0'0 2023-01-24T21:39:54.444353+0000 0 0 periodic scrub scheduled @ 2023-01-26T07:28:02.328042+0000 0 0 2023-01-24T21:43:43.430 INFO:tasks.workunit.client.0.smithi007.stdout:1.7 0 0 0 0 0 0 0 0 0 0 active+clean 2023-01-24T21:39:55.460160+0000 0'0 136:130 [1,2] 1 [1,2] 1 0'0 2023-01-24T21:39:54.444353+0000 0'0 2023-01-24T21:39:54.444353+0000 0 0 periodic scrub scheduled @ 2023-01-25T22:31:52.170453+0000 0 0 2023-01-24T21:43:43.430 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-24T21:43:43.431 INFO:tasks.workunit.client.0.smithi007.stdout:1 0 0 0 0 0 0 0 0 0 0 2023-01-24T21:43:43.431 INFO:tasks.workunit.client.0.smithi007.stdout:2 2 0 0 0 0 590368 0 0 97 97 2023-01-24T21:43:43.431 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-24T21:43:43.431 INFO:tasks.workunit.client.0.smithi007.stdout:sum 2 0 0 0 0 590368 0 0 97 97 2023-01-24T21:43:43.431 INFO:tasks.workunit.client.0.smithi007.stdout:OSD_STAT USED AVAIL USED_RAW TOTAL HB_PEERS PG_SUM PRIMARY_PG_SUM 2023-01-24T21:43:43.432 INFO:tasks.workunit.client.0.smithi007.stdout:2 8.0 MiB 90 GiB 8.0 MiB 90 GiB [0,1] 5 3 2023-01-24T21:43:43.432 INFO:tasks.workunit.client.0.smithi007.stdout:0 7.2 MiB 90 GiB 7.2 MiB 90 GiB [1,2] 6 1 2023-01-24T21:43:43.432 INFO:tasks.workunit.client.0.smithi007.stdout:1 8.1 MiB 90 GiB 8.1 MiB 90 GiB [0,2] 7 5 2023-01-24T21:43:43.432 INFO:tasks.workunit.client.0.smithi007.stdout:sum 23 MiB 270 GiB 23 MiB 270 GiB 2023-01-24T21:43:43.432 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-24T21:43:43.433 INFO:tasks.workunit.client.0.smithi007.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2023-01-24T21:43:43.433 INFO:tasks.workunit.client.0.smithi007.stderr:dumped all 2023-01-24T21:43:43.439 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:633: test_auth_profiles: ceph -n client.xx-profile-ro -k client.xx.keyring mon dump 2023-01-24T21:43:44.009 INFO:tasks.workunit.client.0.smithi007.stdout:epoch 1 2023-01-24T21:43:44.010 INFO:tasks.workunit.client.0.smithi007.stdout:fsid a59d83ed-89b8-47a3-be21-f6c4b4e37305 2023-01-24T21:43:44.010 INFO:tasks.workunit.client.0.smithi007.stdout:last_changed 2023-01-24T21:39:28.570062+0000 2023-01-24T21:43:44.010 INFO:tasks.workunit.client.0.smithi007.stdout:created 2023-01-24T21:39:28.570062+0000 2023-01-24T21:43:44.010 INFO:tasks.workunit.client.0.smithi007.stdout:min_mon_release 17 (quincy) 2023-01-24T21:43:44.010 INFO:tasks.workunit.client.0.smithi007.stdout:election_strategy: 1 2023-01-24T21:43:44.011 INFO:tasks.workunit.client.0.smithi007.stdout:0: v1:172.21.15.7:6789/0 mon.a 2023-01-24T21:43:44.011 INFO:tasks.workunit.client.0.smithi007.stdout:1: v1:172.21.15.7:6790/0 mon.b 2023-01-24T21:43:44.011 INFO:tasks.workunit.client.0.smithi007.stdout:2: v1:172.21.15.7:6791/0 mon.c 2023-01-24T21:43:44.012 INFO:tasks.workunit.client.0.smithi007.stderr:dumped monmap epoch 1 2023-01-24T21:43:44.021 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:635: test_auth_profiles: ceph -n client.xx-profile-ro -k client.xx.keyring log foo 2023-01-24T21:43:44.393 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:635: test_auth_profiles: true 2023-01-24T21:43:44.394 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:636: test_auth_profiles: check_response 'EACCES: access denied' 2023-01-24T21:43:44.394 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:103: check_response: expected_string='EACCES: access denied' 2023-01-24T21:43:44.394 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:104: check_response: retcode= 2023-01-24T21:43:44.394 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:105: check_response: expected_retcode= 2023-01-24T21:43:44.395 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:106: check_response: '[' '' -a '!=' ']' 2023-01-24T21:43:44.395 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:111: check_response: grep --quiet -- 'EACCES: access denied' /tmp/cephtool.5YU/test_invalid.fWm 2023-01-24T21:43:44.395 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:637: test_auth_profiles: ceph -n client.xx-profile-ro -k client.xx.keyring osd set noout 2023-01-24T21:43:44.703 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:637: test_auth_profiles: true 2023-01-24T21:43:44.703 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:638: test_auth_profiles: check_response 'EACCES: access denied' 2023-01-24T21:43:44.704 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:103: check_response: expected_string='EACCES: access denied' 2023-01-24T21:43:44.704 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:104: check_response: retcode= 2023-01-24T21:43:44.704 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:105: check_response: expected_retcode= 2023-01-24T21:43:44.705 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:106: check_response: '[' '' -a '!=' ']' 2023-01-24T21:43:44.705 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:111: check_response: grep --quiet -- 'EACCES: access denied' /tmp/cephtool.5YU/test_invalid.fWm 2023-01-24T21:43:44.705 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:639: test_auth_profiles: ceph -n client.xx-profile-ro -k client.xx.keyring auth ls 2023-01-24T21:43:45.075 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:639: test_auth_profiles: true 2023-01-24T21:43:45.076 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:640: test_auth_profiles: check_response 'EACCES: access denied' 2023-01-24T21:43:45.076 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:103: check_response: expected_string='EACCES: access denied' 2023-01-24T21:43:45.076 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:104: check_response: retcode= 2023-01-24T21:43:45.076 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:105: check_response: expected_retcode= 2023-01-24T21:43:45.076 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:106: check_response: '[' '' -a '!=' ']' 2023-01-24T21:43:45.077 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:111: check_response: grep --quiet -- 'EACCES: access denied' /tmp/cephtool.5YU/test_invalid.fWm 2023-01-24T21:43:45.077 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:643: test_auth_profiles: ceph -n client.xx-profile-rw -k client.xx.keyring status 2023-01-24T21:43:45.639 INFO:tasks.workunit.client.0.smithi007.stdout: cluster: 2023-01-24T21:43:45.640 INFO:tasks.workunit.client.0.smithi007.stdout: id: a59d83ed-89b8-47a3-be21-f6c4b4e37305 2023-01-24T21:43:45.640 INFO:tasks.workunit.client.0.smithi007.stdout: health: HEALTH_OK 2023-01-24T21:43:45.640 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-24T21:43:45.640 INFO:tasks.workunit.client.0.smithi007.stdout: services: 2023-01-24T21:43:45.640 INFO:tasks.workunit.client.0.smithi007.stdout: mon: 3 daemons, quorum a,b,c (age 4m) 2023-01-24T21:43:45.641 INFO:tasks.workunit.client.0.smithi007.stdout: mgr: x(active, since 3m) 2023-01-24T21:43:45.641 INFO:tasks.workunit.client.0.smithi007.stdout: osd: 3 osds: 3 up (since 3m), 3 in (since 3m) 2023-01-24T21:43:45.641 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-24T21:43:45.641 INFO:tasks.workunit.client.0.smithi007.stdout: data: 2023-01-24T21:43:45.642 INFO:tasks.workunit.client.0.smithi007.stdout: pools: 2 pools, 9 pgs 2023-01-24T21:43:45.642 INFO:tasks.workunit.client.0.smithi007.stdout: objects: 2 objects, 577 KiB 2023-01-24T21:43:45.642 INFO:tasks.workunit.client.0.smithi007.stdout: usage: 23 MiB used, 270 GiB / 270 GiB avail 2023-01-24T21:43:45.642 INFO:tasks.workunit.client.0.smithi007.stdout: pgs: 9 active+clean 2023-01-24T21:43:45.642 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-24T21:43:45.651 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:644: test_auth_profiles: ceph -n client.xx-profile-rw -k client.xx.keyring osd dump 2023-01-24T21:43:46.071 INFO:tasks.workunit.client.0.smithi007.stdout:epoch 137 2023-01-24T21:43:46.071 INFO:tasks.workunit.client.0.smithi007.stdout:fsid a59d83ed-89b8-47a3-be21-f6c4b4e37305 2023-01-24T21:43:46.072 INFO:tasks.workunit.client.0.smithi007.stdout:created 2023-01-24T21:39:45.471377+0000 2023-01-24T21:43:46.072 INFO:tasks.workunit.client.0.smithi007.stdout:modified 2023-01-24T21:43:24.838735+0000 2023-01-24T21:43:46.072 INFO:tasks.workunit.client.0.smithi007.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-01-24T21:43:46.072 INFO:tasks.workunit.client.0.smithi007.stdout:crush_version 5 2023-01-24T21:43:46.072 INFO:tasks.workunit.client.0.smithi007.stdout:full_ratio 0.95 2023-01-24T21:43:46.073 INFO:tasks.workunit.client.0.smithi007.stdout:backfillfull_ratio 0.9 2023-01-24T21:43:46.073 INFO:tasks.workunit.client.0.smithi007.stdout:nearfull_ratio 0.85 2023-01-24T21:43:46.073 INFO:tasks.workunit.client.0.smithi007.stdout:require_min_compat_client luminous 2023-01-24T21:43:46.073 INFO:tasks.workunit.client.0.smithi007.stdout:min_compat_client jewel 2023-01-24T21:43:46.074 INFO:tasks.workunit.client.0.smithi007.stdout:require_osd_release quincy 2023-01-24T21:43:46.074 INFO:tasks.workunit.client.0.smithi007.stdout:stretch_mode_enabled false 2023-01-24T21:43:46.074 INFO:tasks.workunit.client.0.smithi007.stdout:pool 1 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 application rbd 2023-01-24T21:43:46.075 INFO:tasks.workunit.client.0.smithi007.stdout:pool 2 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 12 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr 2023-01-24T21:43:46.075 INFO:tasks.workunit.client.0.smithi007.stdout:max_osd 3 2023-01-24T21:43:46.075 INFO:tasks.workunit.client.0.smithi007.stdout:osd.0 up in weight 1 up_from 8 up_thru 128 down_at 0 last_clean_interval [0,0) v1:172.21.15.7:6802/81207 v1:172.21.15.7:6805/81207 exists,up 6d40d965-9a66-46d2-8758-d2034c9feb28 2023-01-24T21:43:46.076 INFO:tasks.workunit.client.0.smithi007.stdout:osd.1 up in weight 1 up_from 8 up_thru 129 down_at 0 last_clean_interval [0,0) v1:172.21.15.7:6800/81208 v1:172.21.15.7:6803/81208 exists,up 0fa19857-21e0-4c68-b4f7-58da09ad64fa 2023-01-24T21:43:46.076 INFO:tasks.workunit.client.0.smithi007.stdout:osd.2 up in weight 1 up_from 8 up_thru 128 down_at 0 last_clean_interval [0,0) v1:172.21.15.7:6801/81209 v1:172.21.15.7:6804/81209 exists,up a94607f3-c9bd-4b4d-8fb2-b1d8a06892c5 2023-01-24T21:43:46.083 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:645: test_auth_profiles: ceph -n client.xx-profile-rw -k client.xx.keyring pg dump 2023-01-24T21:43:46.493 INFO:tasks.workunit.client.0.smithi007.stdout:version 251 2023-01-24T21:43:46.493 INFO:tasks.workunit.client.0.smithi007.stdout:stamp 2023-01-24T21:43:45.100604+0000 2023-01-24T21:43:46.493 INFO:tasks.workunit.client.0.smithi007.stdout:last_osdmap_epoch 0 2023-01-24T21:43:46.494 INFO:tasks.workunit.client.0.smithi007.stdout:last_pg_scan 0 2023-01-24T21:43:46.494 INFO:tasks.workunit.client.0.smithi007.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2023-01-24T21:43:46.494 INFO:tasks.workunit.client.0.smithi007.stdout:1.5 0 0 0 0 0 0 0 0 0 0 active+clean 2023-01-24T21:39:55.461218+0000 0'0 136:123 [2,0] 2 [2,0] 2 0'0 2023-01-24T21:39:54.444353+0000 0'0 2023-01-24T21:39:54.444353+0000 0 0 periodic scrub scheduled @ 2023-01-26T01:39:36.790147+0000 0 0 2023-01-24T21:43:46.494 INFO:tasks.workunit.client.0.smithi007.stdout:1.4 0 0 0 0 0 0 0 0 0 0 active+clean 2023-01-24T21:39:55.458239+0000 0'0 136:130 [1,0] 1 [1,0] 1 0'0 2023-01-24T21:39:54.444353+0000 0'0 2023-01-24T21:39:54.444353+0000 0 0 periodic scrub scheduled @ 2023-01-26T05:04:42.428315+0000 0 0 2023-01-24T21:43:46.494 INFO:tasks.workunit.client.0.smithi007.stdout:1.3 0 0 0 0 0 0 0 0 0 0 active+clean 2023-01-24T21:39:55.459665+0000 0'0 136:130 [1,2] 1 [1,2] 1 0'0 2023-01-24T21:39:54.444353+0000 0'0 2023-01-24T21:39:54.444353+0000 0 0 periodic scrub scheduled @ 2023-01-26T02:01:21.924187+0000 0 0 2023-01-24T21:43:46.495 INFO:tasks.workunit.client.0.smithi007.stdout:2.0 2 0 0 0 0 590368 0 0 97 97 active+clean 2023-01-24T21:39:56.500335+0000 11'97 136:249 [2,1] 2 [2,1] 2 0'0 2023-01-24T21:39:55.447612+0000 0'0 2023-01-24T21:39:55.447612+0000 0 0 periodic scrub scheduled @ 2023-01-26T07:28:03.331300+0000 0 0 2023-01-24T21:43:46.495 INFO:tasks.workunit.client.0.smithi007.stdout:1.2 0 0 0 0 0 0 0 0 0 0 active+clean 2023-01-24T21:39:55.457395+0000 0'0 136:135 [0,1] 0 [0,1] 0 0'0 2023-01-24T21:39:54.444353+0000 0'0 2023-01-24T21:39:54.444353+0000 0 0 periodic scrub scheduled @ 2023-01-26T05:35:20.546509+0000 0 0 2023-01-24T21:43:46.495 INFO:tasks.workunit.client.0.smithi007.stdout:1.0 0 0 0 0 0 0 0 0 0 0 active+clean 2023-01-24T21:39:55.457028+0000 0'0 136:130 [1,0] 1 [1,0] 1 0'0 2023-01-24T21:39:54.444353+0000 0'0 2023-01-24T21:39:54.444353+0000 0 0 periodic scrub scheduled @ 2023-01-26T02:17:09.155039+0000 0 0 2023-01-24T21:43:46.495 INFO:tasks.workunit.client.0.smithi007.stdout:1.1 0 0 0 0 0 0 0 0 0 0 active+clean 2023-01-24T21:39:55.460163+0000 0'0 136:123 [2,0] 2 [2,0] 2 0'0 2023-01-24T21:39:54.444353+0000 0'0 2023-01-24T21:39:54.444353+0000 0 0 periodic scrub scheduled @ 2023-01-25T22:53:13.460426+0000 0 0 2023-01-24T21:43:46.496 INFO:tasks.workunit.client.0.smithi007.stdout:1.6 0 0 0 0 0 0 0 0 0 0 active+clean 2023-01-24T21:39:55.456301+0000 0'0 136:130 [1,0] 1 [1,0] 1 0'0 2023-01-24T21:39:54.444353+0000 0'0 2023-01-24T21:39:54.444353+0000 0 0 periodic scrub scheduled @ 2023-01-26T07:28:02.328042+0000 0 0 2023-01-24T21:43:46.496 INFO:tasks.workunit.client.0.smithi007.stdout:1.7 0 0 0 0 0 0 0 0 0 0 active+clean 2023-01-24T21:39:55.460160+0000 0'0 136:130 [1,2] 1 [1,2] 1 0'0 2023-01-24T21:39:54.444353+0000 0'0 2023-01-24T21:39:54.444353+0000 0 0 periodic scrub scheduled @ 2023-01-25T22:31:52.170453+0000 0 0 2023-01-24T21:43:46.496 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-24T21:43:46.496 INFO:tasks.workunit.client.0.smithi007.stdout:1 0 0 0 0 0 0 0 0 0 0 2023-01-24T21:43:46.496 INFO:tasks.workunit.client.0.smithi007.stdout:2 2 0 0 0 0 590368 0 0 97 97 2023-01-24T21:43:46.497 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-24T21:43:46.497 INFO:tasks.workunit.client.0.smithi007.stdout:sum 2 0 0 0 0 590368 0 0 97 97 2023-01-24T21:43:46.497 INFO:tasks.workunit.client.0.smithi007.stdout:OSD_STAT USED AVAIL USED_RAW TOTAL HB_PEERS PG_SUM PRIMARY_PG_SUM 2023-01-24T21:43:46.497 INFO:tasks.workunit.client.0.smithi007.stdout:2 8.0 MiB 90 GiB 8.0 MiB 90 GiB [0,1] 5 3 2023-01-24T21:43:46.497 INFO:tasks.workunit.client.0.smithi007.stdout:0 7.2 MiB 90 GiB 7.2 MiB 90 GiB [1,2] 6 1 2023-01-24T21:43:46.498 INFO:tasks.workunit.client.0.smithi007.stdout:1 8.1 MiB 90 GiB 8.1 MiB 90 GiB [0,2] 7 5 2023-01-24T21:43:46.498 INFO:tasks.workunit.client.0.smithi007.stdout:sum 23 MiB 270 GiB 23 MiB 270 GiB 2023-01-24T21:43:46.498 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-24T21:43:46.498 INFO:tasks.workunit.client.0.smithi007.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2023-01-24T21:43:46.499 INFO:tasks.workunit.client.0.smithi007.stderr:dumped all 2023-01-24T21:43:46.505 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:646: test_auth_profiles: ceph -n client.xx-profile-rw -k client.xx.keyring mon dump 2023-01-24T21:43:47.074 INFO:tasks.workunit.client.0.smithi007.stdout:epoch 1 2023-01-24T21:43:47.074 INFO:tasks.workunit.client.0.smithi007.stdout:fsid a59d83ed-89b8-47a3-be21-f6c4b4e37305 2023-01-24T21:43:47.075 INFO:tasks.workunit.client.0.smithi007.stdout:last_changed 2023-01-24T21:39:28.570062+0000 2023-01-24T21:43:47.075 INFO:tasks.workunit.client.0.smithi007.stdout:created 2023-01-24T21:39:28.570062+0000 2023-01-24T21:43:47.075 INFO:tasks.workunit.client.0.smithi007.stdout:min_mon_release 17 (quincy) 2023-01-24T21:43:47.075 INFO:tasks.workunit.client.0.smithi007.stdout:election_strategy: 1 2023-01-24T21:43:47.075 INFO:tasks.workunit.client.0.smithi007.stdout:0: v1:172.21.15.7:6789/0 mon.a 2023-01-24T21:43:47.076 INFO:tasks.workunit.client.0.smithi007.stdout:1: v1:172.21.15.7:6790/0 mon.b 2023-01-24T21:43:47.076 INFO:tasks.workunit.client.0.smithi007.stdout:2: v1:172.21.15.7:6791/0 mon.c 2023-01-24T21:43:47.076 INFO:tasks.workunit.client.0.smithi007.stderr:dumped monmap epoch 1 2023-01-24T21:43:47.086 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:647: test_auth_profiles: ceph -n client.xx-profile-rw -k client.xx.keyring fs dump 2023-01-24T21:43:47.588 INFO:tasks.workunit.client.0.smithi007.stdout:e1 2023-01-24T21:43:47.589 INFO:tasks.workunit.client.0.smithi007.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-01-24T21:43:47.589 INFO:tasks.workunit.client.0.smithi007.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-24T21:43:47.589 INFO:tasks.workunit.client.0.smithi007.stdout:legacy client fscid: -1 2023-01-24T21:43:47.589 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-24T21:43:47.589 INFO:tasks.workunit.client.0.smithi007.stdout:No filesystems configured 2023-01-24T21:43:47.591 INFO:tasks.workunit.client.0.smithi007.stderr:dumped fsmap epoch 1 2023-01-24T21:43:47.600 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:648: test_auth_profiles: ceph -n client.xx-profile-rw -k client.xx.keyring log foo 2023-01-24T21:43:49.913 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:649: test_auth_profiles: ceph -n client.xx-profile-rw -k client.xx.keyring osd set noout 2023-01-24T21:43:51.912 INFO:tasks.workunit.client.0.smithi007.stderr:noout is set 2023-01-24T21:43:51.924 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:650: test_auth_profiles: ceph -n client.xx-profile-rw -k client.xx.keyring osd unset noout 2023-01-24T21:43:53.921 INFO:tasks.workunit.client.0.smithi007.stderr:noout is unset 2023-01-24T21:43:53.933 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:652: test_auth_profiles: ceph -n client.xx-profile-rw -k client.xx.keyring auth ls 2023-01-24T21:43:54.315 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:652: test_auth_profiles: true 2023-01-24T21:43:54.316 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:653: test_auth_profiles: check_response 'EACCES: access denied' 2023-01-24T21:43:54.316 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:103: check_response: expected_string='EACCES: access denied' 2023-01-24T21:43:54.317 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:104: check_response: retcode= 2023-01-24T21:43:54.317 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:105: check_response: expected_retcode= 2023-01-24T21:43:54.317 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:106: check_response: '[' '' -a '!=' ']' 2023-01-24T21:43:54.318 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:111: check_response: grep --quiet -- 'EACCES: access denied' /tmp/cephtool.5YU/test_invalid.fWm 2023-01-24T21:43:54.318 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:656: test_auth_profiles: ceph -n client.xx-profile-rd -k client.xx.keyring auth ls 2023-01-24T21:43:54.879 INFO:tasks.workunit.client.0.smithi007.stdout:osd.0 2023-01-24T21:43:54.879 INFO:tasks.workunit.client.0.smithi007.stdout: key: AQASUNBj/KaVCRAA2DKveAyFnNbyHQ4MZSVNbQ== 2023-01-24T21:43:54.879 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [mgr] allow profile osd 2023-01-24T21:43:54.880 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [mon] allow profile osd 2023-01-24T21:43:54.880 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [osd] allow * 2023-01-24T21:43:54.880 INFO:tasks.workunit.client.0.smithi007.stdout:osd.1 2023-01-24T21:43:54.880 INFO:tasks.workunit.client.0.smithi007.stdout: key: AQAVUNBjRGY5ChAA/xWqpbcFXT4DdFyquxEtGw== 2023-01-24T21:43:54.880 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [mgr] allow profile osd 2023-01-24T21:43:54.881 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [mon] allow profile osd 2023-01-24T21:43:54.881 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [osd] allow * 2023-01-24T21:43:54.881 INFO:tasks.workunit.client.0.smithi007.stdout:osd.2 2023-01-24T21:43:54.881 INFO:tasks.workunit.client.0.smithi007.stdout: key: AQAYUNBjpQ1TCRAABPxEfAFQYfJ3YipEDkwIgg== 2023-01-24T21:43:54.882 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [mgr] allow profile osd 2023-01-24T21:43:54.882 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [mon] allow profile osd 2023-01-24T21:43:54.882 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [osd] allow * 2023-01-24T21:43:54.882 INFO:tasks.workunit.client.0.smithi007.stdout:client.0 2023-01-24T21:43:54.882 INFO:tasks.workunit.client.0.smithi007.stdout: key: AQARUNBjvhAFChAAUN6tOmTKKqwA5MfkTBswDg== 2023-01-24T21:43:54.883 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [mds] allow 2023-01-24T21:43:54.883 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [mgr] allow r 2023-01-24T21:43:54.883 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [mon] allow rw 2023-01-24T21:43:54.883 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [osd] allow rwx 2023-01-24T21:43:54.883 INFO:tasks.workunit.client.0.smithi007.stdout:client.admin 2023-01-24T21:43:54.884 INFO:tasks.workunit.client.0.smithi007.stdout: key: AQAQUNBjASPsMRAAXX79ZwJZIC6NUcpKNsgb7g== 2023-01-24T21:43:54.884 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [mds] allow * 2023-01-24T21:43:54.884 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [mgr] allow * 2023-01-24T21:43:54.884 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [mon] allow * 2023-01-24T21:43:54.884 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [osd] allow * 2023-01-24T21:43:54.885 INFO:tasks.workunit.client.0.smithi007.stdout:client.bootstrap-mds 2023-01-24T21:43:54.885 INFO:tasks.workunit.client.0.smithi007.stdout: key: AQAhUNBjwd8jHBAAnLJNPTTH0Pwgca6WL0gFkQ== 2023-01-24T21:43:54.885 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [mon] allow profile bootstrap-mds 2023-01-24T21:43:54.885 INFO:tasks.workunit.client.0.smithi007.stdout:client.bootstrap-mgr 2023-01-24T21:43:54.885 INFO:tasks.workunit.client.0.smithi007.stdout: key: AQAhUNBjResjHBAAR3fAFDc2TrMjIfbYkq4iMg== 2023-01-24T21:43:54.886 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [mon] allow profile bootstrap-mgr 2023-01-24T21:43:54.886 INFO:tasks.workunit.client.0.smithi007.stdout:client.bootstrap-osd 2023-01-24T21:43:54.886 INFO:tasks.workunit.client.0.smithi007.stdout: key: AQAhUNBj4PUjHBAAESMEqsTyO/d5fn0RsDhX8A== 2023-01-24T21:43:54.886 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [mon] allow profile bootstrap-osd 2023-01-24T21:43:54.886 INFO:tasks.workunit.client.0.smithi007.stdout:client.bootstrap-rbd 2023-01-24T21:43:54.886 INFO:tasks.workunit.client.0.smithi007.stdout: key: AQAhUNBjDgAkHBAAGrLKaC20ypUBUf+rvpaK8g== 2023-01-24T21:43:54.887 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [mon] allow profile bootstrap-rbd 2023-01-24T21:43:54.887 INFO:tasks.workunit.client.0.smithi007.stdout:client.bootstrap-rbd-mirror 2023-01-24T21:43:54.887 INFO:tasks.workunit.client.0.smithi007.stdout: key: AQAhUNBjTwkkHBAAOewtNsqJOEP1xXTioaTBgg== 2023-01-24T21:43:54.887 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [mon] allow profile bootstrap-rbd-mirror 2023-01-24T21:43:54.887 INFO:tasks.workunit.client.0.smithi007.stdout:client.bootstrap-rgw 2023-01-24T21:43:54.888 INFO:tasks.workunit.client.0.smithi007.stdout: key: AQAhUNBj6BIkHBAAg/Sc0I1PTkm0onTWOiesgw== 2023-01-24T21:43:54.888 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [mon] allow profile bootstrap-rgw 2023-01-24T21:43:54.888 INFO:tasks.workunit.client.0.smithi007.stdout:client.xx-profile-rd 2023-01-24T21:43:54.888 INFO:tasks.workunit.client.0.smithi007.stdout: key: AQANUdBjCGSDDRAA740l/JW+0dQYR6m6D5zB3A== 2023-01-24T21:43:54.889 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [mon] allow profile role-definer 2023-01-24T21:43:54.889 INFO:tasks.workunit.client.0.smithi007.stdout:client.xx-profile-ro 2023-01-24T21:43:54.889 INFO:tasks.workunit.client.0.smithi007.stdout: key: AQAMUdBjIB+pAxAAYF5OxoggBFJ6qYPQNrM0ug== 2023-01-24T21:43:54.889 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [mgr] allow profile read-only 2023-01-24T21:43:54.889 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [mon] allow profile read-only 2023-01-24T21:43:54.889 INFO:tasks.workunit.client.0.smithi007.stdout:client.xx-profile-rw 2023-01-24T21:43:54.890 INFO:tasks.workunit.client.0.smithi007.stdout: key: AQAMUdBj84VwJhAABDEuCcgPOTFMkeXmQ3IvXQ== 2023-01-24T21:43:54.890 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [mgr] allow profile read-write 2023-01-24T21:43:54.890 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [mon] allow profile read-write 2023-01-24T21:43:54.890 INFO:tasks.workunit.client.0.smithi007.stdout:mgr.x 2023-01-24T21:43:54.891 INFO:tasks.workunit.client.0.smithi007.stdout: key: AQARUNBjQ8SQBxAAIvAEYI3aaEgbao6Ypz5hMw== 2023-01-24T21:43:54.891 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [mds] allow * 2023-01-24T21:43:54.891 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [mon] allow profile mgr 2023-01-24T21:43:54.891 INFO:tasks.workunit.client.0.smithi007.stdout: caps: [osd] allow * 2023-01-24T21:43:54.892 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:657: test_auth_profiles: ceph -n client.xx-profile-rd -k client.xx.keyring auth export 2023-01-24T21:43:55.453 INFO:tasks.workunit.client.0.smithi007.stdout:[osd.0] 2023-01-24T21:43:55.453 INFO:tasks.workunit.client.0.smithi007.stdout: key = AQASUNBj/KaVCRAA2DKveAyFnNbyHQ4MZSVNbQ== 2023-01-24T21:43:55.454 INFO:tasks.workunit.client.0.smithi007.stdout: caps mgr = "allow profile osd" 2023-01-24T21:43:55.454 INFO:tasks.workunit.client.0.smithi007.stdout: caps mon = "allow profile osd" 2023-01-24T21:43:55.454 INFO:tasks.workunit.client.0.smithi007.stdout: caps osd = "allow *" 2023-01-24T21:43:55.454 INFO:tasks.workunit.client.0.smithi007.stdout:[osd.1] 2023-01-24T21:43:55.455 INFO:tasks.workunit.client.0.smithi007.stdout: key = AQAVUNBjRGY5ChAA/xWqpbcFXT4DdFyquxEtGw== 2023-01-24T21:43:55.455 INFO:tasks.workunit.client.0.smithi007.stdout: caps mgr = "allow profile osd" 2023-01-24T21:43:55.455 INFO:tasks.workunit.client.0.smithi007.stdout: caps mon = "allow profile osd" 2023-01-24T21:43:55.455 INFO:tasks.workunit.client.0.smithi007.stdout: caps osd = "allow *" 2023-01-24T21:43:55.456 INFO:tasks.workunit.client.0.smithi007.stdout:[osd.2] 2023-01-24T21:43:55.456 INFO:tasks.workunit.client.0.smithi007.stdout: key = AQAYUNBjpQ1TCRAABPxEfAFQYfJ3YipEDkwIgg== 2023-01-24T21:43:55.456 INFO:tasks.workunit.client.0.smithi007.stdout: caps mgr = "allow profile osd" 2023-01-24T21:43:55.456 INFO:tasks.workunit.client.0.smithi007.stdout: caps mon = "allow profile osd" 2023-01-24T21:43:55.456 INFO:tasks.workunit.client.0.smithi007.stdout: caps osd = "allow *" 2023-01-24T21:43:55.457 INFO:tasks.workunit.client.0.smithi007.stdout:[client.0] 2023-01-24T21:43:55.457 INFO:tasks.workunit.client.0.smithi007.stdout: key = AQARUNBjvhAFChAAUN6tOmTKKqwA5MfkTBswDg== 2023-01-24T21:43:55.457 INFO:tasks.workunit.client.0.smithi007.stdout: caps mds = "allow" 2023-01-24T21:43:55.457 INFO:tasks.workunit.client.0.smithi007.stdout: caps mgr = "allow r" 2023-01-24T21:43:55.457 INFO:tasks.workunit.client.0.smithi007.stdout: caps mon = "allow rw" 2023-01-24T21:43:55.458 INFO:tasks.workunit.client.0.smithi007.stdout: caps osd = "allow rwx" 2023-01-24T21:43:55.458 INFO:tasks.workunit.client.0.smithi007.stdout:[client.admin] 2023-01-24T21:43:55.458 INFO:tasks.workunit.client.0.smithi007.stdout: key = AQAQUNBjASPsMRAAXX79ZwJZIC6NUcpKNsgb7g== 2023-01-24T21:43:55.458 INFO:tasks.workunit.client.0.smithi007.stdout: caps mds = "allow *" 2023-01-24T21:43:55.458 INFO:tasks.workunit.client.0.smithi007.stdout: caps mgr = "allow *" 2023-01-24T21:43:55.458 INFO:tasks.workunit.client.0.smithi007.stdout: caps mon = "allow *" 2023-01-24T21:43:55.459 INFO:tasks.workunit.client.0.smithi007.stdout: caps osd = "allow *" 2023-01-24T21:43:55.459 INFO:tasks.workunit.client.0.smithi007.stdout:[client.bootstrap-mds] 2023-01-24T21:43:55.459 INFO:tasks.workunit.client.0.smithi007.stdout: key = AQAhUNBjwd8jHBAAnLJNPTTH0Pwgca6WL0gFkQ== 2023-01-24T21:43:55.459 INFO:tasks.workunit.client.0.smithi007.stdout: caps mon = "allow profile bootstrap-mds" 2023-01-24T21:43:55.459 INFO:tasks.workunit.client.0.smithi007.stdout:[client.bootstrap-mgr] 2023-01-24T21:43:55.460 INFO:tasks.workunit.client.0.smithi007.stdout: key = AQAhUNBjResjHBAAR3fAFDc2TrMjIfbYkq4iMg== 2023-01-24T21:43:55.460 INFO:tasks.workunit.client.0.smithi007.stdout: caps mon = "allow profile bootstrap-mgr" 2023-01-24T21:43:55.460 INFO:tasks.workunit.client.0.smithi007.stdout:[client.bootstrap-osd] 2023-01-24T21:43:55.460 INFO:tasks.workunit.client.0.smithi007.stdout: key = AQAhUNBj4PUjHBAAESMEqsTyO/d5fn0RsDhX8A== 2023-01-24T21:43:55.460 INFO:tasks.workunit.client.0.smithi007.stdout: caps mon = "allow profile bootstrap-osd" 2023-01-24T21:43:55.461 INFO:tasks.workunit.client.0.smithi007.stdout:[client.bootstrap-rbd] 2023-01-24T21:43:55.461 INFO:tasks.workunit.client.0.smithi007.stdout: key = AQAhUNBjDgAkHBAAGrLKaC20ypUBUf+rvpaK8g== 2023-01-24T21:43:55.461 INFO:tasks.workunit.client.0.smithi007.stdout: caps mon = "allow profile bootstrap-rbd" 2023-01-24T21:43:55.461 INFO:tasks.workunit.client.0.smithi007.stdout:[client.bootstrap-rbd-mirror] 2023-01-24T21:43:55.461 INFO:tasks.workunit.client.0.smithi007.stdout: key = AQAhUNBjTwkkHBAAOewtNsqJOEP1xXTioaTBgg== 2023-01-24T21:43:55.462 INFO:tasks.workunit.client.0.smithi007.stdout: caps mon = "allow profile bootstrap-rbd-mirror" 2023-01-24T21:43:55.462 INFO:tasks.workunit.client.0.smithi007.stdout:[client.bootstrap-rgw] 2023-01-24T21:43:55.462 INFO:tasks.workunit.client.0.smithi007.stdout: key = AQAhUNBj6BIkHBAAg/Sc0I1PTkm0onTWOiesgw== 2023-01-24T21:43:55.462 INFO:tasks.workunit.client.0.smithi007.stdout: caps mon = "allow profile bootstrap-rgw" 2023-01-24T21:43:55.462 INFO:tasks.workunit.client.0.smithi007.stdout:[client.xx-profile-rd] 2023-01-24T21:43:55.463 INFO:tasks.workunit.client.0.smithi007.stdout: key = AQANUdBjCGSDDRAA740l/JW+0dQYR6m6D5zB3A== 2023-01-24T21:43:55.463 INFO:tasks.workunit.client.0.smithi007.stdout: caps mon = "allow profile role-definer" 2023-01-24T21:43:55.463 INFO:tasks.workunit.client.0.smithi007.stdout:[client.xx-profile-ro] 2023-01-24T21:43:55.463 INFO:tasks.workunit.client.0.smithi007.stdout: key = AQAMUdBjIB+pAxAAYF5OxoggBFJ6qYPQNrM0ug== 2023-01-24T21:43:55.463 INFO:tasks.workunit.client.0.smithi007.stdout: caps mgr = "allow profile read-only" 2023-01-24T21:43:55.464 INFO:tasks.workunit.client.0.smithi007.stdout: caps mon = "allow profile read-only" 2023-01-24T21:43:55.464 INFO:tasks.workunit.client.0.smithi007.stdout:[client.xx-profile-rw] 2023-01-24T21:43:55.464 INFO:tasks.workunit.client.0.smithi007.stdout: key = AQAMUdBj84VwJhAABDEuCcgPOTFMkeXmQ3IvXQ== 2023-01-24T21:43:55.465 INFO:tasks.workunit.client.0.smithi007.stdout: caps mgr = "allow profile read-write" 2023-01-24T21:43:55.465 INFO:tasks.workunit.client.0.smithi007.stdout: caps mon = "allow profile read-write" 2023-01-24T21:43:55.465 INFO:tasks.workunit.client.0.smithi007.stdout:[mgr.x] 2023-01-24T21:43:55.465 INFO:tasks.workunit.client.0.smithi007.stdout: key = AQARUNBjQ8SQBxAAIvAEYI3aaEgbao6Ypz5hMw== 2023-01-24T21:43:55.465 INFO:tasks.workunit.client.0.smithi007.stdout: caps mds = "allow *" 2023-01-24T21:43:55.466 INFO:tasks.workunit.client.0.smithi007.stdout: caps mon = "allow profile mgr" 2023-01-24T21:43:55.466 INFO:tasks.workunit.client.0.smithi007.stdout: caps osd = "allow *" 2023-01-24T21:43:55.466 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:658: test_auth_profiles: ceph -n client.xx-profile-rd -k client.xx.keyring auth add client.xx-profile-foo 2023-01-24T21:43:56.051 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:659: test_auth_profiles: ceph -n client.xx-profile-rd -k client.xx.keyring status 2023-01-24T21:43:56.614 INFO:tasks.workunit.client.0.smithi007.stdout: cluster: 2023-01-24T21:43:56.614 INFO:tasks.workunit.client.0.smithi007.stdout: id: a59d83ed-89b8-47a3-be21-f6c4b4e37305 2023-01-24T21:43:56.614 INFO:tasks.workunit.client.0.smithi007.stdout: health: HEALTH_OK 2023-01-24T21:43:56.615 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-24T21:43:56.615 INFO:tasks.workunit.client.0.smithi007.stdout: services: 2023-01-24T21:43:56.615 INFO:tasks.workunit.client.0.smithi007.stdout: mon: 3 daemons, quorum a,b,c (age 4m) 2023-01-24T21:43:56.615 INFO:tasks.workunit.client.0.smithi007.stdout: mgr: x(active, since 4m) 2023-01-24T21:43:56.615 INFO:tasks.workunit.client.0.smithi007.stdout: osd: 3 osds: 3 up (since 4m), 3 in (since 4m) 2023-01-24T21:43:56.616 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-24T21:43:56.616 INFO:tasks.workunit.client.0.smithi007.stdout: data: 2023-01-24T21:43:56.616 INFO:tasks.workunit.client.0.smithi007.stdout: pools: 2 pools, 9 pgs 2023-01-24T21:43:56.616 INFO:tasks.workunit.client.0.smithi007.stdout: objects: 2 objects, 577 KiB 2023-01-24T21:43:56.617 INFO:tasks.workunit.client.0.smithi007.stdout: usage: 24 MiB used, 270 GiB / 270 GiB avail 2023-01-24T21:43:56.617 INFO:tasks.workunit.client.0.smithi007.stdout: pgs: 9 active+clean 2023-01-24T21:43:56.617 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-24T21:43:56.626 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:660: test_auth_profiles: ceph -n client.xx-profile-rd -k client.xx.keyring osd dump 2023-01-24T21:43:56.925 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:660: test_auth_profiles: true 2023-01-24T21:43:56.925 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:661: test_auth_profiles: check_response 'EACCES: access denied' 2023-01-24T21:43:56.925 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:103: check_response: expected_string='EACCES: access denied' 2023-01-24T21:43:56.926 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:104: check_response: retcode= 2023-01-24T21:43:56.926 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:105: check_response: expected_retcode= 2023-01-24T21:43:56.926 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:106: check_response: '[' '' -a '!=' ']' 2023-01-24T21:43:56.926 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:111: check_response: grep --quiet -- 'EACCES: access denied' /tmp/cephtool.5YU/test_invalid.fWm 2023-01-24T21:43:56.927 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:662: test_auth_profiles: ceph -n client.xx-profile-rd -k client.xx.keyring pg dump 2023-01-24T21:43:57.213 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-01-24T21:43:57.211+0000 7f0c24ef0700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2023-01-24T21:43:57.217 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:662: test_auth_profiles: true 2023-01-24T21:43:57.217 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:663: test_auth_profiles: check_response 'EACCES: access denied' 2023-01-24T21:43:57.217 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:103: check_response: expected_string='EACCES: access denied' 2023-01-24T21:43:57.217 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:104: check_response: retcode= 2023-01-24T21:43:57.218 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:105: check_response: expected_retcode= 2023-01-24T21:43:57.218 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:106: check_response: '[' '' -a '!=' ']' 2023-01-24T21:43:57.218 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:111: check_response: grep --quiet -- 'EACCES: access denied' /tmp/cephtool.5YU/test_invalid.fWm 2023-01-24T21:43:57.220 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:665: test_auth_profiles: ceph -n client.xx-profile-rd -k client.xx.keyring mon dump 2023-01-24T21:43:57.789 INFO:tasks.workunit.client.0.smithi007.stdout:epoch 1 2023-01-24T21:43:57.789 INFO:tasks.workunit.client.0.smithi007.stdout:fsid a59d83ed-89b8-47a3-be21-f6c4b4e37305 2023-01-24T21:43:57.789 INFO:tasks.workunit.client.0.smithi007.stdout:last_changed 2023-01-24T21:39:28.570062+0000 2023-01-24T21:43:57.789 INFO:tasks.workunit.client.0.smithi007.stdout:created 2023-01-24T21:39:28.570062+0000 2023-01-24T21:43:57.790 INFO:tasks.workunit.client.0.smithi007.stdout:min_mon_release 17 (quincy) 2023-01-24T21:43:57.790 INFO:tasks.workunit.client.0.smithi007.stdout:election_strategy: 1 2023-01-24T21:43:57.790 INFO:tasks.workunit.client.0.smithi007.stdout:0: v1:172.21.15.7:6789/0 mon.a 2023-01-24T21:43:57.790 INFO:tasks.workunit.client.0.smithi007.stdout:1: v1:172.21.15.7:6790/0 mon.b 2023-01-24T21:43:57.790 INFO:tasks.workunit.client.0.smithi007.stdout:2: v1:172.21.15.7:6791/0 mon.c 2023-01-24T21:43:57.791 INFO:tasks.workunit.client.0.smithi007.stderr:dumped monmap epoch 1 2023-01-24T21:43:57.801 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:667: test_auth_profiles: ceph -n client.xx-profile-rd -k client.xx.keyring mon add foo 1.1.1.1 2023-01-24T21:43:58.180 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:667: test_auth_profiles: true 2023-01-24T21:43:58.181 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:668: test_auth_profiles: check_response 'EACCES: access denied' 2023-01-24T21:43:58.182 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:103: check_response: expected_string='EACCES: access denied' 2023-01-24T21:43:58.182 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:104: check_response: retcode= 2023-01-24T21:43:58.182 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:105: check_response: expected_retcode= 2023-01-24T21:43:58.182 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:106: check_response: '[' '' -a '!=' ']' 2023-01-24T21:43:58.183 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:111: check_response: grep --quiet -- 'EACCES: access denied' /tmp/cephtool.5YU/test_invalid.fWm 2023-01-24T21:43:58.183 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:669: test_auth_profiles: ceph -n client.xx-profile-rd -k client.xx.keyring fs dump 2023-01-24T21:43:58.526 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:669: test_auth_profiles: true 2023-01-24T21:43:58.526 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:670: test_auth_profiles: check_response 'EACCES: access denied' 2023-01-24T21:43:58.526 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:103: check_response: expected_string='EACCES: access denied' 2023-01-24T21:43:58.527 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:104: check_response: retcode= 2023-01-24T21:43:58.527 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:105: check_response: expected_retcode= 2023-01-24T21:43:58.528 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:106: check_response: '[' '' -a '!=' ']' 2023-01-24T21:43:58.528 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:111: check_response: grep --quiet -- 'EACCES: access denied' /tmp/cephtool.5YU/test_invalid.fWm 2023-01-24T21:43:58.528 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:671: test_auth_profiles: ceph -n client.xx-profile-rd -k client.xx.keyring log foo 2023-01-24T21:43:58.897 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:671: test_auth_profiles: true 2023-01-24T21:43:58.898 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:672: test_auth_profiles: check_response 'EACCES: access denied' 2023-01-24T21:43:58.898 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:103: check_response: expected_string='EACCES: access denied' 2023-01-24T21:43:58.898 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:104: check_response: retcode= 2023-01-24T21:43:58.898 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:105: check_response: expected_retcode= 2023-01-24T21:43:58.899 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:106: check_response: '[' '' -a '!=' ']' 2023-01-24T21:43:58.899 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:111: check_response: grep --quiet -- 'EACCES: access denied' /tmp/cephtool.5YU/test_invalid.fWm 2023-01-24T21:43:58.899 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:673: test_auth_profiles: ceph -n client.xx-profile-rd -k client.xx.keyring osd set noout 2023-01-24T21:43:59.210 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:673: test_auth_profiles: true 2023-01-24T21:43:59.210 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:674: test_auth_profiles: check_response 'EACCES: access denied' 2023-01-24T21:43:59.210 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:103: check_response: expected_string='EACCES: access denied' 2023-01-24T21:43:59.210 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:104: check_response: retcode= 2023-01-24T21:43:59.211 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:105: check_response: expected_retcode= 2023-01-24T21:43:59.211 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:106: check_response: '[' '' -a '!=' ']' 2023-01-24T21:43:59.211 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:111: check_response: grep --quiet -- 'EACCES: access denied' /tmp/cephtool.5YU/test_invalid.fWm 2023-01-24T21:43:59.211 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:676: test_auth_profiles: ceph -n client.xx-profile-rd -k client.xx.keyring auth del client.xx-profile-ro 2023-01-24T21:43:59.792 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:677: test_auth_profiles: ceph -n client.xx-profile-rd -k client.xx.keyring auth del client.xx-profile-rw 2023-01-24T21:44:00.388 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:680: test_auth_profiles: ceph -n client.xx-profile-rd -k client.xx.keyring auth add client.xx-profile-rd2 mon 'allow profile role-definer' 2023-01-24T21:44:00.980 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:682: test_auth_profiles: ceph -n client.xx-profile-rd -k client.xx.keyring auth export 2023-01-24T21:44:01.559 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:685: test_auth_profiles: ceph -n client.xx-profile-rd2 -k client.xx.keyring.2 auth del client.xx-profile-rd 2023-01-24T21:44:02.146 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:688: test_auth_profiles: ceph auth del client.xx-profile-rd2 2023-01-24T21:44:02.730 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:689: test_auth_profiles: rm -f client.xx.keyring client.xx.keyring.2 2023-01-24T21:44:02.731 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2973: main: set +x 2023-01-24T21:44:03.158 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:2972: main: test_mon_misc 2023-01-24T21:44:03.159 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:718: test_mon_misc: ceph osd dump 2023-01-24T21:44:03.159 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:718: test_mon_misc: grep '^epoch' 2023-01-24T21:44:03.585 INFO:tasks.workunit.client.0.smithi007.stdout:epoch 141 2023-01-24T21:44:03.586 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:719: test_mon_misc: ceph --concise osd dump 2023-01-24T21:44:03.587 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:719: test_mon_misc: grep '^epoch' 2023-01-24T21:44:04.019 INFO:tasks.workunit.client.0.smithi007.stdout:epoch 141 2023-01-24T21:44:04.020 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:721: test_mon_misc: ceph osd df 2023-01-24T21:44:04.020 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:721: test_mon_misc: grep 'MIN/MAX VAR' 2023-01-24T21:44:04.441 INFO:tasks.workunit.client.0.smithi007.stdout:MIN/MAX VAR: 0.94/1.03 STDDEV: 0 2023-01-24T21:44:04.441 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:724: test_mon_misc: ceph df 2023-01-24T21:44:05.023 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:725: test_mon_misc: grep RAW /tmp/cephtool.5YU/test_invalid.fWm 2023-01-24T21:44:05.024 INFO:tasks.workunit.client.0.smithi007.stdout:--- RAW STORAGE --- 2023-01-24T21:44:05.024 INFO:tasks.workunit.client.0.smithi007.stdout:CLASS SIZE AVAIL USED RAW USED %RAW USED 2023-01-24T21:44:05.025 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:726: test_mon_misc: grep -v DIRTY /tmp/cephtool.5YU/test_invalid.fWm 2023-01-24T21:44:05.025 INFO:tasks.workunit.client.0.smithi007.stdout:--- RAW STORAGE --- 2023-01-24T21:44:05.025 INFO:tasks.workunit.client.0.smithi007.stdout:CLASS SIZE AVAIL USED RAW USED %RAW USED 2023-01-24T21:44:05.026 INFO:tasks.workunit.client.0.smithi007.stdout:ssd 270 GiB 270 GiB 24 MiB 24 MiB 0 2023-01-24T21:44:05.026 INFO:tasks.workunit.client.0.smithi007.stdout:TOTAL 270 GiB 270 GiB 24 MiB 24 MiB 0 2023-01-24T21:44:05.026 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-24T21:44:05.026 INFO:tasks.workunit.client.0.smithi007.stdout:--- POOLS --- 2023-01-24T21:44:05.026 INFO:tasks.workunit.client.0.smithi007.stdout:POOL ID PGS STORED OBJECTS USED %USED MAX AVAIL 2023-01-24T21:44:05.027 INFO:tasks.workunit.client.0.smithi007.stdout:rbd 1 8 0 B 0 0 B 0 128 GiB 2023-01-24T21:44:05.027 INFO:tasks.workunit.client.0.smithi007.stdout:.mgr 2 1 456 KiB 2 920 KiB 0 128 GiB 2023-01-24T21:44:05.027 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:727: test_mon_misc: ceph df detail 2023-01-24T21:44:05.605 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:728: test_mon_misc: grep DIRTY /tmp/cephtool.5YU/test_invalid.fWm 2023-01-24T21:44:05.605 INFO:tasks.workunit.client.0.smithi007.stdout:POOL ID PGS STORED (DATA) (OMAP) OBJECTS USED (DATA) (OMAP) %USED MAX AVAIL QUOTA OBJECTS QUOTA BYTES DIRTY USED COMPR UNDER COMPR 2023-01-24T21:44:05.606 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:729: test_mon_misc: ceph df --format json 2023-01-24T21:44:06.179 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:730: test_mon_misc: grep total_bytes /tmp/cephtool.5YU/test_invalid.fWm 2023-01-24T21:44:06.180 INFO:tasks.workunit.client.0.smithi007.stdout:{"stats":{"total_bytes":289910292480,"total_avail_bytes":289885642752,"total_used_bytes":24649728,"total_used_raw_bytes":24649728,"total_used_raw_ratio":8.5025363659951836e-05,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3},"stats_by_class":{"ssd":{"total_bytes":289910292480,"total_avail_bytes":289885642752,"total_used_bytes":24649728,"total_used_raw_bytes":24649728,"total_used_raw_ratio":8.5025363659951836e-05}},"pools":[{"name":"rbd","id":1,"stats":{"stored":0,"objects":0,"kb_used":0,"bytes_used":0,"percent_used":0,"max_avail":137694658560}},{"name":".mgr","id":2,"stats":{"stored":466956,"objects":2,"kb_used":920,"bytes_used":942080,"percent_used":3.4208906072308309e-06,"max_avail":137694658560}}]} 2023-01-24T21:44:06.181 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:731: test_mon_misc: grep -v dirty /tmp/cephtool.5YU/test_invalid.fWm 2023-01-24T21:44:06.182 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-24T21:44:06.182 INFO:tasks.workunit.client.0.smithi007.stdout:{"stats":{"total_bytes":289910292480,"total_avail_bytes":289885642752,"total_used_bytes":24649728,"total_used_raw_bytes":24649728,"total_used_raw_ratio":8.5025363659951836e-05,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3},"stats_by_class":{"ssd":{"total_bytes":289910292480,"total_avail_bytes":289885642752,"total_used_bytes":24649728,"total_used_raw_bytes":24649728,"total_used_raw_ratio":8.5025363659951836e-05}},"pools":[{"name":"rbd","id":1,"stats":{"stored":0,"objects":0,"kb_used":0,"bytes_used":0,"percent_used":0,"max_avail":137694658560}},{"name":".mgr","id":2,"stats":{"stored":466956,"objects":2,"kb_used":920,"bytes_used":942080,"percent_used":3.4208906072308309e-06,"max_avail":137694658560}}]} 2023-01-24T21:44:06.183 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:732: test_mon_misc: ceph df detail --format json 2023-01-24T21:44:06.766 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:733: test_mon_misc: grep rd_bytes /tmp/cephtool.5YU/test_invalid.fWm 2023-01-24T21:44:06.767 INFO:tasks.workunit.client.0.smithi007.stdout:{"stats":{"total_bytes":289910292480,"total_avail_bytes":289885642752,"total_used_bytes":24649728,"total_used_raw_bytes":24649728,"total_used_raw_ratio":8.5025363659951836e-05,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3},"stats_by_class":{"ssd":{"total_bytes":289910292480,"total_avail_bytes":289885642752,"total_used_bytes":24649728,"total_used_raw_bytes":24649728,"total_used_raw_ratio":8.5025363659951836e-05}},"pools":[{"name":"rbd","id":1,"stats":{"stored":0,"stored_data":0,"stored_omap":0,"objects":0,"kb_used":0,"bytes_used":0,"data_bytes_used":0,"omap_bytes_used":0,"percent_used":0,"max_avail":137694658560,"quota_objects":0,"quota_bytes":0,"dirty":0,"rd":0,"rd_bytes":0,"wr":0,"wr_bytes":0,"compress_bytes_used":0,"compress_under_bytes":0,"stored_raw":0,"avail_raw":275389317744}},{"name":".mgr","id":2,"stats":{"stored":466956,"stored_data":466956,"stored_omap":0,"objects":2,"kb_used":920,"bytes_used":942080,"data_bytes_used":942080,"omap_bytes_used":0,"percent_used":3.4208906072308309e-06,"max_avail":137694658560,"quota_objects":0,"quota_bytes":0,"dirty":0,"rd":106,"rd_bytes":93184,"wr":137,"wr_bytes":1939456,"compress_bytes_used":0,"compress_under_bytes":0,"stored_raw":933912,"avail_raw":275389317744}}]} 2023-01-24T21:44:06.767 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:734: test_mon_misc: grep dirty /tmp/cephtool.5YU/test_invalid.fWm 2023-01-24T21:44:06.768 INFO:tasks.workunit.client.0.smithi007.stdout:{"stats":{"total_bytes":289910292480,"total_avail_bytes":289885642752,"total_used_bytes":24649728,"total_used_raw_bytes":24649728,"total_used_raw_ratio":8.5025363659951836e-05,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3},"stats_by_class":{"ssd":{"total_bytes":289910292480,"total_avail_bytes":289885642752,"total_used_bytes":24649728,"total_used_raw_bytes":24649728,"total_used_raw_ratio":8.5025363659951836e-05}},"pools":[{"name":"rbd","id":1,"stats":{"stored":0,"stored_data":0,"stored_omap":0,"objects":0,"kb_used":0,"bytes_used":0,"data_bytes_used":0,"omap_bytes_used":0,"percent_used":0,"max_avail":137694658560,"quota_objects":0,"quota_bytes":0,"dirty":0,"rd":0,"rd_bytes":0,"wr":0,"wr_bytes":0,"compress_bytes_used":0,"compress_under_bytes":0,"stored_raw":0,"avail_raw":275389317744}},{"name":".mgr","id":2,"stats":{"stored":466956,"stored_data":466956,"stored_omap":0,"objects":2,"kb_used":920,"bytes_used":942080,"data_bytes_used":942080,"omap_bytes_used":0,"percent_used":3.4208906072308309e-06,"max_avail":137694658560,"quota_objects":0,"quota_bytes":0,"dirty":0,"rd":106,"rd_bytes":93184,"wr":137,"wr_bytes":1939456,"compress_bytes_used":0,"compress_under_bytes":0,"stored_raw":933912,"avail_raw":275389317744}}]} 2023-01-24T21:44:06.769 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:735: test_mon_misc: ceph df --format xml 2023-01-24T21:44:06.769 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:735: test_mon_misc: grep '' 2023-01-24T21:44:07.346 INFO:tasks.workunit.client.0.smithi007.stdout:28991029248028988564275224649728246497288.5025363659951836e-0533328991029248028988564275224649728246497288.5025363659951836e-05rbd100000137694658560.mgr246695629209420803.4208906072308309e-06137694658560 2023-01-24T21:44:07.347 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:736: test_mon_misc: ceph df detail --format xml 2023-01-24T21:44:07.347 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:736: test_mon_misc: grep '' 2023-01-24T21:44:07.926 INFO:tasks.workunit.client.0.smithi007.stdout:28991029248028988564275224649728246497288.5025363659951836e-0533328991029248028988564275224649728246497288.5025363659951836e-05rbd10000000001376946585600000000000275389317744.mgr24669564669560292094208094208003.4208906072308309e-0613769465856000010693184137193945600933912275389317744 2023-01-24T21:44:07.927 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:738: test_mon_misc: ceph fsid 2023-01-24T21:44:08.494 INFO:tasks.workunit.client.0.smithi007.stdout:a59d83ed-89b8-47a3-be21-f6c4b4e37305 2023-01-24T21:44:08.506 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:739: test_mon_misc: ceph health 2023-01-24T21:44:09.078 INFO:tasks.workunit.client.0.smithi007.stdout:HEALTH_OK 2023-01-24T21:44:09.090 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:740: test_mon_misc: ceph health detail 2023-01-24T21:44:09.655 INFO:tasks.workunit.client.0.smithi007.stdout:HEALTH_OK 2023-01-24T21:44:09.667 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:741: test_mon_misc: ceph health --format json-pretty 2023-01-24T21:44:10.239 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-24T21:44:10.239 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2023-01-24T21:44:10.240 INFO:tasks.workunit.client.0.smithi007.stdout: "status": "HEALTH_OK", 2023-01-24T21:44:10.240 INFO:tasks.workunit.client.0.smithi007.stdout: "checks": {}, 2023-01-24T21:44:10.240 INFO:tasks.workunit.client.0.smithi007.stdout: "mutes": [] 2023-01-24T21:44:10.240 INFO:tasks.workunit.client.0.smithi007.stdout:} 2023-01-24T21:44:10.251 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:742: test_mon_misc: ceph health detail --format xml-pretty 2023-01-24T21:44:10.818 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-24T21:44:10.819 INFO:tasks.workunit.client.0.smithi007.stdout: HEALTH_OK 2023-01-24T21:44:10.819 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-24T21:44:10.819 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-24T21:44:10.819 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-24T21:44:10.819 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-24T21:44:10.820 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-24T21:44:10.830 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:744: test_mon_misc: ceph time-sync-status 2023-01-24T21:44:11.400 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2023-01-24T21:44:11.401 INFO:tasks.workunit.client.0.smithi007.stdout: "time_skew_status": { 2023-01-24T21:44:11.401 INFO:tasks.workunit.client.0.smithi007.stdout: "a": { 2023-01-24T21:44:11.401 INFO:tasks.workunit.client.0.smithi007.stdout: "skew": 0, 2023-01-24T21:44:11.402 INFO:tasks.workunit.client.0.smithi007.stdout: "latency": 0, 2023-01-24T21:44:11.402 INFO:tasks.workunit.client.0.smithi007.stdout: "health": "HEALTH_OK" 2023-01-24T21:44:11.403 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:11.403 INFO:tasks.workunit.client.0.smithi007.stdout: "b": { 2023-01-24T21:44:11.403 INFO:tasks.workunit.client.0.smithi007.stdout: "skew": 0, 2023-01-24T21:44:11.404 INFO:tasks.workunit.client.0.smithi007.stdout: "latency": 0.000833394, 2023-01-24T21:44:11.404 INFO:tasks.workunit.client.0.smithi007.stdout: "health": "HEALTH_OK" 2023-01-24T21:44:11.404 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:11.405 INFO:tasks.workunit.client.0.smithi007.stdout: "c": { 2023-01-24T21:44:11.405 INFO:tasks.workunit.client.0.smithi007.stdout: "skew": 0, 2023-01-24T21:44:11.406 INFO:tasks.workunit.client.0.smithi007.stdout: "latency": 0.00075540199999999996, 2023-01-24T21:44:11.406 INFO:tasks.workunit.client.0.smithi007.stdout: "health": "HEALTH_OK" 2023-01-24T21:44:11.406 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:11.407 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:11.407 INFO:tasks.workunit.client.0.smithi007.stdout: "timechecks": { 2023-01-24T21:44:11.407 INFO:tasks.workunit.client.0.smithi007.stdout: "epoch": 8, 2023-01-24T21:44:11.408 INFO:tasks.workunit.client.0.smithi007.stdout: "round": 2, 2023-01-24T21:44:11.408 INFO:tasks.workunit.client.0.smithi007.stdout: "round_status": "finished" 2023-01-24T21:44:11.409 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:11.409 INFO:tasks.workunit.client.0.smithi007.stdout:} 2023-01-24T21:44:11.412 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:746: test_mon_misc: ceph node ls 2023-01-24T21:44:11.985 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2023-01-24T21:44:11.985 INFO:tasks.workunit.client.0.smithi007.stdout: "mon": { 2023-01-24T21:44:11.986 INFO:tasks.workunit.client.0.smithi007.stdout: "smithi007": [ 2023-01-24T21:44:11.986 INFO:tasks.workunit.client.0.smithi007.stdout: "a", 2023-01-24T21:44:11.986 INFO:tasks.workunit.client.0.smithi007.stdout: "b", 2023-01-24T21:44:11.986 INFO:tasks.workunit.client.0.smithi007.stdout: "c" 2023-01-24T21:44:11.987 INFO:tasks.workunit.client.0.smithi007.stdout: ] 2023-01-24T21:44:11.987 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:11.987 INFO:tasks.workunit.client.0.smithi007.stdout: "osd": { 2023-01-24T21:44:11.988 INFO:tasks.workunit.client.0.smithi007.stdout: "smithi007": [ 2023-01-24T21:44:11.988 INFO:tasks.workunit.client.0.smithi007.stdout: 0, 2023-01-24T21:44:11.988 INFO:tasks.workunit.client.0.smithi007.stdout: 1, 2023-01-24T21:44:11.989 INFO:tasks.workunit.client.0.smithi007.stdout: 2 2023-01-24T21:44:11.989 INFO:tasks.workunit.client.0.smithi007.stdout: ] 2023-01-24T21:44:11.989 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:11.990 INFO:tasks.workunit.client.0.smithi007.stdout: "mgr": { 2023-01-24T21:44:11.990 INFO:tasks.workunit.client.0.smithi007.stdout: "smithi007": [ 2023-01-24T21:44:11.990 INFO:tasks.workunit.client.0.smithi007.stdout: "x" 2023-01-24T21:44:11.991 INFO:tasks.workunit.client.0.smithi007.stdout: ] 2023-01-24T21:44:11.991 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:11.991 INFO:tasks.workunit.client.0.smithi007.stdout:} 2023-01-24T21:44:11.997 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:747: test_mon_misc: for t in mon osd mds mgr 2023-01-24T21:44:11.998 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:748: test_mon_misc: ceph node ls mon 2023-01-24T21:44:12.565 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2023-01-24T21:44:12.566 INFO:tasks.workunit.client.0.smithi007.stdout: "smithi007": [ 2023-01-24T21:44:12.566 INFO:tasks.workunit.client.0.smithi007.stdout: "a", 2023-01-24T21:44:12.566 INFO:tasks.workunit.client.0.smithi007.stdout: "b", 2023-01-24T21:44:12.566 INFO:tasks.workunit.client.0.smithi007.stdout: "c" 2023-01-24T21:44:12.567 INFO:tasks.workunit.client.0.smithi007.stdout: ] 2023-01-24T21:44:12.567 INFO:tasks.workunit.client.0.smithi007.stdout:} 2023-01-24T21:44:12.578 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:747: test_mon_misc: for t in mon osd mds mgr 2023-01-24T21:44:12.578 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:748: test_mon_misc: ceph node ls osd 2023-01-24T21:44:13.150 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2023-01-24T21:44:13.150 INFO:tasks.workunit.client.0.smithi007.stdout: "smithi007": [ 2023-01-24T21:44:13.151 INFO:tasks.workunit.client.0.smithi007.stdout: 0, 2023-01-24T21:44:13.151 INFO:tasks.workunit.client.0.smithi007.stdout: 1, 2023-01-24T21:44:13.151 INFO:tasks.workunit.client.0.smithi007.stdout: 2 2023-01-24T21:44:13.151 INFO:tasks.workunit.client.0.smithi007.stdout: ] 2023-01-24T21:44:13.151 INFO:tasks.workunit.client.0.smithi007.stdout:} 2023-01-24T21:44:13.162 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:747: test_mon_misc: for t in mon osd mds mgr 2023-01-24T21:44:13.163 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:748: test_mon_misc: ceph node ls mds 2023-01-24T21:44:13.748 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:747: test_mon_misc: for t in mon osd mds mgr 2023-01-24T21:44:13.748 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:748: test_mon_misc: ceph node ls mgr 2023-01-24T21:44:14.320 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2023-01-24T21:44:14.320 INFO:tasks.workunit.client.0.smithi007.stdout: "smithi007": [ 2023-01-24T21:44:14.321 INFO:tasks.workunit.client.0.smithi007.stdout: "x" 2023-01-24T21:44:14.321 INFO:tasks.workunit.client.0.smithi007.stdout: ] 2023-01-24T21:44:14.321 INFO:tasks.workunit.client.0.smithi007.stdout:} 2023-01-24T21:44:14.332 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:751: test_mon_misc: ceph_watch_start 2023-01-24T21:44:14.332 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:155: ceph_watch_start: local whatch_opt=--watch 2023-01-24T21:44:14.333 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:157: ceph_watch_start: '[' -n '' ']' 2023-01-24T21:44:14.333 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:164: ceph_watch_start: CEPH_WATCH_FILE=/tmp/cephtool.5YU/CEPH_WATCH_84876 2023-01-24T21:44:14.333 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:166: ceph_watch_start: CEPH_WATCH_PID=93005 2023-01-24T21:44:14.333 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:165: ceph_watch_start: ceph --watch 2023-01-24T21:44:14.333 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:170: ceph_watch_start: seq 3 2023-01-24T21:44:14.334 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:170: ceph_watch_start: for i in `seq 3` 2023-01-24T21:44:14.334 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:171: ceph_watch_start: grep -q cluster /tmp/cephtool.5YU/CEPH_WATCH_84876 2023-01-24T21:44:14.335 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:172: ceph_watch_start: sleep 1 2023-01-24T21:44:15.335 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:170: ceph_watch_start: for i in `seq 3` 2023-01-24T21:44:15.335 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:171: ceph_watch_start: grep -q cluster /tmp/cephtool.5YU/CEPH_WATCH_84876 2023-01-24T21:44:15.336 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:172: ceph_watch_start: sleep 1 2023-01-24T21:44:16.338 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:170: ceph_watch_start: for i in `seq 3` 2023-01-24T21:44:16.338 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:171: ceph_watch_start: grep -q cluster /tmp/cephtool.5YU/CEPH_WATCH_84876 2023-01-24T21:44:16.339 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:172: ceph_watch_start: sleep 1 2023-01-24T21:44:17.341 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:752: test_mon_misc: date 2023-01-24T21:44:17.341 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:752: test_mon_misc: mymsg='this is a test log message 84876.Tue Jan 24 21:44:17 UTC 2023' 2023-01-24T21:44:17.342 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:753: test_mon_misc: ceph log 'this is a test log message 84876.Tue Jan 24 21:44:17 UTC 2023' 2023-01-24T21:44:19.493 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:754: test_mon_misc: ceph log last 2023-01-24T21:44:19.493 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:754: test_mon_misc: grep 'this is a test log message 84876.Tue Jan 24 21:44:17 UTC 2023' 2023-01-24T21:44:20.083 INFO:tasks.workunit.client.0.smithi007.stdout:2023-01-24T21:44:17.723531+0000 client.admin (client.6211) 0 : cluster [INF] this is a test log message 84876.Tue Jan 24 21:44:17 UTC 2023 2023-01-24T21:44:20.083 INFO:tasks.workunit.client.0.smithi007.stdout:2023-01-24T21:44:18.679087+0000 client.admin (client.6211) 0 : cluster [INF] this is a test log message 84876.Tue Jan 24 21:44:17 UTC 2023 2023-01-24T21:44:20.084 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:755: test_mon_misc: ceph log last 100 2023-01-24T21:44:20.084 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:755: test_mon_misc: grep 'this is a test log message 84876.Tue Jan 24 21:44:17 UTC 2023' 2023-01-24T21:44:20.667 INFO:tasks.workunit.client.0.smithi007.stdout:2023-01-24T21:44:17.723531+0000 client.admin (client.6211) 0 : cluster [INF] this is a test log message 84876.Tue Jan 24 21:44:17 UTC 2023 2023-01-24T21:44:20.667 INFO:tasks.workunit.client.0.smithi007.stdout:2023-01-24T21:44:18.679087+0000 client.admin (client.6211) 0 : cluster [INF] this is a test log message 84876.Tue Jan 24 21:44:17 UTC 2023 2023-01-24T21:44:20.668 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:756: test_mon_misc: ceph_watch_wait 'this is a test log message 84876.Tue Jan 24 21:44:17 UTC 2023' 2023-01-24T21:44:20.669 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:178: ceph_watch_wait: local 'regexp=this is a test log message 84876.Tue Jan 24 21:44:17 UTC 2023' 2023-01-24T21:44:20.669 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:179: ceph_watch_wait: local timeout=30 2023-01-24T21:44:20.669 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:181: ceph_watch_wait: '[' -n '' ']' 2023-01-24T21:44:20.670 INFO:tasks.workunit.client.0.smithi007.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:185: ceph_watch_wait: seq 30 2023-01-24T21:44:20.670 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:185: ceph_watch_wait: for i in `seq ${timeout}` 2023-01-24T21:44:20.671 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:186: ceph_watch_wait: grep -q 'this is a test log message 84876.Tue Jan 24 21:44:17 UTC 2023' /tmp/cephtool.5YU/CEPH_WATCH_84876 2023-01-24T21:44:20.671 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:186: ceph_watch_wait: break 2023-01-24T21:44:20.672 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:190: ceph_watch_wait: kill 93005 2023-01-24T21:44:20.672 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:192: ceph_watch_wait: grep 'this is a test log message 84876.Tue Jan 24 21:44:17 UTC 2023' /tmp/cephtool.5YU/CEPH_WATCH_84876 2023-01-24T21:44:20.672 INFO:tasks.workunit.client.0.smithi007.stdout:2023-01-24T21:44:17.723531+0000 client.admin [INF] this is a test log message 84876.Tue Jan 24 21:44:17 UTC 2023 2023-01-24T21:44:20.673 INFO:tasks.workunit.client.0.smithi007.stdout:2023-01-24T21:44:18.679087+0000 client.admin [INF] this is a test log message 84876.Tue Jan 24 21:44:17 UTC 2023 2023-01-24T21:44:20.673 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:758: test_mon_misc: ceph mgr stat 2023-01-24T21:44:21.187 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2023-01-24T21:44:21.188 INFO:tasks.workunit.client.0.smithi007.stdout: "epoch": 5, 2023-01-24T21:44:21.189 INFO:tasks.workunit.client.0.smithi007.stdout: "available": true, 2023-01-24T21:44:21.189 INFO:tasks.workunit.client.0.smithi007.stdout: "active_name": "x", 2023-01-24T21:44:21.189 INFO:tasks.workunit.client.0.smithi007.stdout: "num_standby": 0 2023-01-24T21:44:21.189 INFO:tasks.workunit.client.0.smithi007.stdout:} 2023-01-24T21:44:21.202 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh: line 716: 93005 Terminated ceph $whatch_opt > $CEPH_WATCH_FILE 2023-01-24T21:44:21.203 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh:759: test_mon_misc: ceph mgr dump 2023-01-24T21:44:21.729 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2023-01-24T21:44:21.730 INFO:tasks.workunit.client.0.smithi007.stdout: "epoch": 5, 2023-01-24T21:44:21.730 INFO:tasks.workunit.client.0.smithi007.stdout: "active_gid": 4104, 2023-01-24T21:44:21.731 INFO:tasks.workunit.client.0.smithi007.stdout: "active_name": "x", 2023-01-24T21:44:21.731 INFO:tasks.workunit.client.0.smithi007.stdout: "active_addrs": { 2023-01-24T21:44:21.731 INFO:tasks.workunit.client.0.smithi007.stdout: "addrvec": [ 2023-01-24T21:44:21.731 INFO:tasks.workunit.client.0.smithi007.stdout: { 2023-01-24T21:44:21.731 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "v1", 2023-01-24T21:44:21.732 INFO:tasks.workunit.client.0.smithi007.stdout: "addr": "172.21.15.7:6812", 2023-01-24T21:44:21.732 INFO:tasks.workunit.client.0.smithi007.stdout: "nonce": 80782 2023-01-24T21:44:21.732 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:21.732 INFO:tasks.workunit.client.0.smithi007.stdout: ] 2023-01-24T21:44:21.732 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.733 INFO:tasks.workunit.client.0.smithi007.stdout: "active_addr": "172.21.15.7:6812/80782", 2023-01-24T21:44:21.733 INFO:tasks.workunit.client.0.smithi007.stdout: "active_change": "2023-01-24T21:39:51.059919+0000", 2023-01-24T21:44:21.734 INFO:tasks.workunit.client.0.smithi007.stdout: "active_mgr_features": 4540138320759226367, 2023-01-24T21:44:21.734 INFO:tasks.workunit.client.0.smithi007.stdout: "available": true, 2023-01-24T21:44:21.734 INFO:tasks.workunit.client.0.smithi007.stdout: "standbys": [], 2023-01-24T21:44:21.735 INFO:tasks.workunit.client.0.smithi007.stdout: "modules": [ 2023-01-24T21:44:21.735 INFO:tasks.workunit.client.0.smithi007.stdout: "iostat", 2023-01-24T21:44:21.735 INFO:tasks.workunit.client.0.smithi007.stdout: "nfs", 2023-01-24T21:44:21.736 INFO:tasks.workunit.client.0.smithi007.stdout: "restful" 2023-01-24T21:44:21.736 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:21.737 INFO:tasks.workunit.client.0.smithi007.stdout: "available_modules": [ 2023-01-24T21:44:21.737 INFO:tasks.workunit.client.0.smithi007.stdout: { 2023-01-24T21:44:21.737 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "alerts", 2023-01-24T21:44:21.738 INFO:tasks.workunit.client.0.smithi007.stdout: "can_run": true, 2023-01-24T21:44:21.738 INFO:tasks.workunit.client.0.smithi007.stdout: "error_string": "", 2023-01-24T21:44:21.738 INFO:tasks.workunit.client.0.smithi007.stdout: "module_options": { 2023-01-24T21:44:21.739 INFO:tasks.workunit.client.0.smithi007.stdout: "interval": { 2023-01-24T21:44:21.739 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "interval", 2023-01-24T21:44:21.740 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "secs", 2023-01-24T21:44:21.740 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.740 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.741 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "60", 2023-01-24T21:44:21.741 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.741 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.742 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.742 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "How frequently to reexamine health status", 2023-01-24T21:44:21.742 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.742 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.743 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.743 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.743 INFO:tasks.workunit.client.0.smithi007.stdout: "log_level": { 2023-01-24T21:44:21.743 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_level", 2023-01-24T21:44:21.744 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.744 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.744 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.744 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:21.744 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.745 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.745 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:21.745 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:21.745 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:21.746 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:21.746 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:21.746 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:21.747 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:21.747 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:21.747 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:21.748 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.748 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.748 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.748 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.749 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster": { 2023-01-24T21:44:21.749 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster", 2023-01-24T21:44:21.749 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:21.749 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.749 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.750 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:21.750 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.750 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.750 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.751 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:21.751 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.751 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.751 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.752 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.752 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster_level": { 2023-01-24T21:44:21.752 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster_level", 2023-01-24T21:44:21.752 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.753 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.753 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.753 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "info", 2023-01-24T21:44:21.753 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.754 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.754 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:21.754 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:21.754 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:21.754 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:21.755 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:21.755 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:21.755 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:21.755 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:21.755 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:21.755 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.756 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.756 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.756 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.756 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_file": { 2023-01-24T21:44:21.757 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_file", 2023-01-24T21:44:21.757 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:21.757 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.757 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.757 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:21.758 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.758 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.758 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.759 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:21.759 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.760 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.760 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.760 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.761 INFO:tasks.workunit.client.0.smithi007.stdout: "smtp_destination": { 2023-01-24T21:44:21.761 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "smtp_destination", 2023-01-24T21:44:21.761 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.762 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.762 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.763 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:21.763 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.763 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.764 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.764 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Email address to send alerts to", 2023-01-24T21:44:21.764 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.764 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.765 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.765 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.765 INFO:tasks.workunit.client.0.smithi007.stdout: "smtp_from_name": { 2023-01-24T21:44:21.765 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "smtp_from_name", 2023-01-24T21:44:21.766 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.766 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.766 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.767 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "Ceph", 2023-01-24T21:44:21.767 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.767 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.768 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.768 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Email From: name", 2023-01-24T21:44:21.768 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.768 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.768 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.769 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.769 INFO:tasks.workunit.client.0.smithi007.stdout: "smtp_host": { 2023-01-24T21:44:21.769 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "smtp_host", 2023-01-24T21:44:21.769 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.769 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.770 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.770 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:21.770 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.770 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.770 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.771 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "SMTP server", 2023-01-24T21:44:21.771 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.771 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.771 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.771 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.772 INFO:tasks.workunit.client.0.smithi007.stdout: "smtp_password": { 2023-01-24T21:44:21.772 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "smtp_password", 2023-01-24T21:44:21.772 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.772 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.772 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.773 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:21.773 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.773 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.773 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.773 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Password to authenticate with", 2023-01-24T21:44:21.774 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.774 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.774 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.774 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.774 INFO:tasks.workunit.client.0.smithi007.stdout: "smtp_port": { 2023-01-24T21:44:21.774 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "smtp_port", 2023-01-24T21:44:21.775 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "int", 2023-01-24T21:44:21.775 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.775 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.775 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "465", 2023-01-24T21:44:21.775 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.776 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.776 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.776 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "SMTP port", 2023-01-24T21:44:21.776 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.776 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.777 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.777 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.777 INFO:tasks.workunit.client.0.smithi007.stdout: "smtp_sender": { 2023-01-24T21:44:21.777 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "smtp_sender", 2023-01-24T21:44:21.778 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.778 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.778 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.778 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:21.778 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.778 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.779 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.779 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "SMTP envelope sender", 2023-01-24T21:44:21.779 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.779 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.779 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.780 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.780 INFO:tasks.workunit.client.0.smithi007.stdout: "smtp_ssl": { 2023-01-24T21:44:21.780 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "smtp_ssl", 2023-01-24T21:44:21.780 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:21.780 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.781 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.781 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:21.781 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.781 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.781 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.782 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Use SSL to connect to SMTP server", 2023-01-24T21:44:21.782 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.782 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.782 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.782 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.783 INFO:tasks.workunit.client.0.smithi007.stdout: "smtp_user": { 2023-01-24T21:44:21.783 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "smtp_user", 2023-01-24T21:44:21.783 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.783 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.783 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.784 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:21.784 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.784 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.784 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.785 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "User to authenticate as", 2023-01-24T21:44:21.785 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.785 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.785 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.785 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:21.786 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:21.786 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.786 INFO:tasks.workunit.client.0.smithi007.stdout: { 2023-01-24T21:44:21.786 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "balancer", 2023-01-24T21:44:21.786 INFO:tasks.workunit.client.0.smithi007.stdout: "can_run": true, 2023-01-24T21:44:21.787 INFO:tasks.workunit.client.0.smithi007.stdout: "error_string": "", 2023-01-24T21:44:21.787 INFO:tasks.workunit.client.0.smithi007.stdout: "module_options": { 2023-01-24T21:44:21.787 INFO:tasks.workunit.client.0.smithi007.stdout: "active": { 2023-01-24T21:44:21.787 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "active", 2023-01-24T21:44:21.787 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:21.788 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.788 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.788 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:21.788 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.788 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.789 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.789 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "automatically balance PGs across cluster", 2023-01-24T21:44:21.789 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.789 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.789 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.790 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.790 INFO:tasks.workunit.client.0.smithi007.stdout: "begin_time": { 2023-01-24T21:44:21.790 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "begin_time", 2023-01-24T21:44:21.790 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.790 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.791 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.791 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "0000", 2023-01-24T21:44:21.791 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.791 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.791 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.792 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "beginning time of day to automatically balance", 2023-01-24T21:44:21.792 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-01-24T21:44:21.792 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.792 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.792 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.793 INFO:tasks.workunit.client.0.smithi007.stdout: "begin_weekday": { 2023-01-24T21:44:21.793 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "begin_weekday", 2023-01-24T21:44:21.793 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "uint", 2023-01-24T21:44:21.793 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.793 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.794 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "0", 2023-01-24T21:44:21.794 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "0", 2023-01-24T21:44:21.794 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "7", 2023-01-24T21:44:21.794 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.795 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-01-24T21:44:21.795 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2023-01-24T21:44:21.795 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.795 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.795 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.796 INFO:tasks.workunit.client.0.smithi007.stdout: "crush_compat_max_iterations": { 2023-01-24T21:44:21.796 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "crush_compat_max_iterations", 2023-01-24T21:44:21.796 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "uint", 2023-01-24T21:44:21.796 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.796 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.797 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "25", 2023-01-24T21:44:21.797 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "1", 2023-01-24T21:44:21.797 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "250", 2023-01-24T21:44:21.797 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.797 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-01-24T21:44:21.798 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.798 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.798 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.798 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.798 INFO:tasks.workunit.client.0.smithi007.stdout: "crush_compat_metrics": { 2023-01-24T21:44:21.799 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "crush_compat_metrics", 2023-01-24T21:44:21.799 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.799 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.799 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.799 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "pgs,objects,bytes", 2023-01-24T21:44:21.799 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.800 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.800 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.800 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-01-24T21:44:21.800 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-01-24T21:44:21.801 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.801 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.801 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.802 INFO:tasks.workunit.client.0.smithi007.stdout: "crush_compat_step": { 2023-01-24T21:44:21.802 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "crush_compat_step", 2023-01-24T21:44:21.802 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "float", 2023-01-24T21:44:21.802 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.803 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.803 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "0.5", 2023-01-24T21:44:21.804 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "0.001", 2023-01-24T21:44:21.804 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "0.999", 2023-01-24T21:44:21.804 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.805 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "aggressiveness of optimization", 2023-01-24T21:44:21.805 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-01-24T21:44:21.805 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.805 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.805 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.806 INFO:tasks.workunit.client.0.smithi007.stdout: "end_time": { 2023-01-24T21:44:21.806 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "end_time", 2023-01-24T21:44:21.806 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.806 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.806 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.807 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "2400", 2023-01-24T21:44:21.807 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.807 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.807 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.808 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "ending time of day to automatically balance", 2023-01-24T21:44:21.808 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-01-24T21:44:21.808 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.808 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.808 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.809 INFO:tasks.workunit.client.0.smithi007.stdout: "end_weekday": { 2023-01-24T21:44:21.809 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "end_weekday", 2023-01-24T21:44:21.809 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "uint", 2023-01-24T21:44:21.809 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.809 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.810 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "7", 2023-01-24T21:44:21.810 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "0", 2023-01-24T21:44:21.810 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "7", 2023-01-24T21:44:21.810 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.810 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-01-24T21:44:21.811 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2023-01-24T21:44:21.811 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.811 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.812 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.812 INFO:tasks.workunit.client.0.smithi007.stdout: "log_level": { 2023-01-24T21:44:21.812 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_level", 2023-01-24T21:44:21.813 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.813 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.813 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.813 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:21.813 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.814 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.814 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:21.814 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:21.814 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:21.815 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:21.815 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:21.815 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:21.816 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:21.816 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:21.816 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:21.816 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.816 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.817 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.817 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.817 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster": { 2023-01-24T21:44:21.817 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster", 2023-01-24T21:44:21.817 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:21.818 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.818 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.818 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:21.818 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.818 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.819 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.819 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:21.819 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.819 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.820 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.820 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.820 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster_level": { 2023-01-24T21:44:21.820 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster_level", 2023-01-24T21:44:21.820 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.821 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.821 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.821 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "info", 2023-01-24T21:44:21.821 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.821 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.822 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:21.822 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:21.822 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:21.822 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:21.823 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:21.823 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:21.823 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:21.823 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:21.823 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:21.824 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.824 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.824 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.824 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.824 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_file": { 2023-01-24T21:44:21.825 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_file", 2023-01-24T21:44:21.825 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:21.825 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.825 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.825 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:21.826 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.826 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.826 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.826 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:21.827 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.827 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.827 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.828 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.828 INFO:tasks.workunit.client.0.smithi007.stdout: "min_score": { 2023-01-24T21:44:21.828 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "min_score", 2023-01-24T21:44:21.829 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "float", 2023-01-24T21:44:21.829 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.830 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.830 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "0", 2023-01-24T21:44:21.830 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.831 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.831 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.831 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-01-24T21:44:21.832 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.832 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.832 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.833 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.833 INFO:tasks.workunit.client.0.smithi007.stdout: "mode": { 2023-01-24T21:44:21.833 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "mode", 2023-01-24T21:44:21.834 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.834 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.834 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.835 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "upmap", 2023-01-24T21:44:21.835 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.835 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.836 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:21.836 INFO:tasks.workunit.client.0.smithi007.stdout: "crush-compat", 2023-01-24T21:44:21.837 INFO:tasks.workunit.client.0.smithi007.stdout: "none", 2023-01-24T21:44:21.837 INFO:tasks.workunit.client.0.smithi007.stdout: "upmap" 2023-01-24T21:44:21.837 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:21.837 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Balancer mode", 2023-01-24T21:44:21.837 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.838 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.838 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.838 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.838 INFO:tasks.workunit.client.0.smithi007.stdout: "pool_ids": { 2023-01-24T21:44:21.838 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "pool_ids", 2023-01-24T21:44:21.839 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.839 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.839 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.839 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:21.839 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.840 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.840 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.840 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-01-24T21:44:21.841 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.841 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.841 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.841 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.841 INFO:tasks.workunit.client.0.smithi007.stdout: "sleep_interval": { 2023-01-24T21:44:21.842 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "sleep_interval", 2023-01-24T21:44:21.842 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "secs", 2023-01-24T21:44:21.842 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.842 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.842 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "60", 2023-01-24T21:44:21.843 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.843 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.843 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.843 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-01-24T21:44:21.843 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.844 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.844 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.844 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.844 INFO:tasks.workunit.client.0.smithi007.stdout: "upmap_max_deviation": { 2023-01-24T21:44:21.844 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "upmap_max_deviation", 2023-01-24T21:44:21.845 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "int", 2023-01-24T21:44:21.845 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.845 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.845 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "5", 2023-01-24T21:44:21.845 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "1", 2023-01-24T21:44:21.846 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.846 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.846 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "deviation below which no optimization is attempted", 2023-01-24T21:44:21.846 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-01-24T21:44:21.846 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.847 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.847 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.847 INFO:tasks.workunit.client.0.smithi007.stdout: "upmap_max_optimizations": { 2023-01-24T21:44:21.848 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "upmap_max_optimizations", 2023-01-24T21:44:21.848 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "uint", 2023-01-24T21:44:21.848 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.848 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.848 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "10", 2023-01-24T21:44:21.849 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.849 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.849 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.849 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-01-24T21:44:21.849 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.850 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.850 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.850 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:21.850 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:21.850 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.851 INFO:tasks.workunit.client.0.smithi007.stdout: { 2023-01-24T21:44:21.851 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "cephadm", 2023-01-24T21:44:21.851 INFO:tasks.workunit.client.0.smithi007.stdout: "can_run": true, 2023-01-24T21:44:21.851 INFO:tasks.workunit.client.0.smithi007.stdout: "error_string": "", 2023-01-24T21:44:21.852 INFO:tasks.workunit.client.0.smithi007.stdout: "module_options": { 2023-01-24T21:44:21.852 INFO:tasks.workunit.client.0.smithi007.stdout: "agent_down_multiplier": { 2023-01-24T21:44:21.852 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "agent_down_multiplier", 2023-01-24T21:44:21.852 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "float", 2023-01-24T21:44:21.853 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.853 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.853 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "3.0", 2023-01-24T21:44:21.853 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.853 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.854 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.854 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-01-24T21:44:21.854 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.854 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.854 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.855 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.855 INFO:tasks.workunit.client.0.smithi007.stdout: "agent_refresh_rate": { 2023-01-24T21:44:21.855 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "agent_refresh_rate", 2023-01-24T21:44:21.855 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "secs", 2023-01-24T21:44:21.856 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.856 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.856 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "20", 2023-01-24T21:44:21.856 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.856 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.857 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.857 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-01-24T21:44:21.857 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.858 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.858 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.858 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.858 INFO:tasks.workunit.client.0.smithi007.stdout: "agent_starting_port": { 2023-01-24T21:44:21.858 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "agent_starting_port", 2023-01-24T21:44:21.859 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "int", 2023-01-24T21:44:21.859 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.859 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.859 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "4721", 2023-01-24T21:44:21.860 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.860 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.860 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.860 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-01-24T21:44:21.860 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.861 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.861 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.861 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.861 INFO:tasks.workunit.client.0.smithi007.stdout: "allow_ptrace": { 2023-01-24T21:44:21.861 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "allow_ptrace", 2023-01-24T21:44:21.862 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:21.862 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.862 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.862 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:21.862 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.863 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.863 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.863 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-01-24T21:44:21.863 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-01-24T21:44:21.863 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.864 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.864 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.864 INFO:tasks.workunit.client.0.smithi007.stdout: "autotune_interval": { 2023-01-24T21:44:21.865 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "autotune_interval", 2023-01-24T21:44:21.865 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "secs", 2023-01-24T21:44:21.865 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.865 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.866 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "600", 2023-01-24T21:44:21.866 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.866 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.867 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.867 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "how frequently to autotune daemon memory", 2023-01-24T21:44:21.868 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.868 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.868 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.869 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.869 INFO:tasks.workunit.client.0.smithi007.stdout: "autotune_memory_target_ratio": { 2023-01-24T21:44:21.869 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "autotune_memory_target_ratio", 2023-01-24T21:44:21.870 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "float", 2023-01-24T21:44:21.870 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.870 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.871 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "0.7", 2023-01-24T21:44:21.871 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.871 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.872 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.872 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-01-24T21:44:21.873 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.873 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.873 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.874 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.874 INFO:tasks.workunit.client.0.smithi007.stdout: "cgroups_split": { 2023-01-24T21:44:21.874 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "cgroups_split", 2023-01-24T21:44:21.874 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:21.874 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.875 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.875 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:21.875 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.875 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.875 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.876 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-01-24T21:44:21.876 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.876 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.876 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.877 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.877 INFO:tasks.workunit.client.0.smithi007.stdout: "config_checks_enabled": { 2023-01-24T21:44:21.877 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "config_checks_enabled", 2023-01-24T21:44:21.877 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:21.877 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.877 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.878 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:21.878 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.878 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.878 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.879 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-01-24T21:44:21.879 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.879 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.880 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.880 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.880 INFO:tasks.workunit.client.0.smithi007.stdout: "config_dashboard": { 2023-01-24T21:44:21.881 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "config_dashboard", 2023-01-24T21:44:21.881 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:21.881 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.881 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.882 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:21.882 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.882 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.883 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.883 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-01-24T21:44:21.883 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.883 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.884 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.884 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.884 INFO:tasks.workunit.client.0.smithi007.stdout: "container_image_alertmanager": { 2023-01-24T21:44:21.885 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "container_image_alertmanager", 2023-01-24T21:44:21.885 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.886 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.886 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.886 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.23.0", 2023-01-24T21:44:21.887 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.887 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.887 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.888 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Prometheus container image", 2023-01-24T21:44:21.888 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.888 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.889 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.889 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.889 INFO:tasks.workunit.client.0.smithi007.stdout: "container_image_base": { 2023-01-24T21:44:21.890 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "container_image_base", 2023-01-24T21:44:21.890 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.891 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.891 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.891 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "quay.io/ceph/ceph", 2023-01-24T21:44:21.892 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.892 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.892 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.892 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Container image name, without the tag", 2023-01-24T21:44:21.893 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.893 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.893 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.893 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.894 INFO:tasks.workunit.client.0.smithi007.stdout: "container_image_grafana": { 2023-01-24T21:44:21.894 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "container_image_grafana", 2023-01-24T21:44:21.894 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.895 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.895 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.895 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "quay.io/ceph/ceph-grafana:8.3.5", 2023-01-24T21:44:21.896 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.896 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.896 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.897 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Prometheus container image", 2023-01-24T21:44:21.897 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.897 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.898 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.898 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.899 INFO:tasks.workunit.client.0.smithi007.stdout: "container_image_haproxy": { 2023-01-24T21:44:21.899 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "container_image_haproxy", 2023-01-24T21:44:21.899 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.900 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.900 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.900 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-01-24T21:44:21.901 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.901 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.901 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.902 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "HAproxy container image", 2023-01-24T21:44:21.902 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.902 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.903 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.903 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.903 INFO:tasks.workunit.client.0.smithi007.stdout: "container_image_keepalived": { 2023-01-24T21:44:21.903 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "container_image_keepalived", 2023-01-24T21:44:21.904 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.904 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.904 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.904 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "quay.io/ceph/keepalived:2.1.5", 2023-01-24T21:44:21.905 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.905 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.905 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.905 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Keepalived container image", 2023-01-24T21:44:21.905 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.906 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.906 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.906 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.906 INFO:tasks.workunit.client.0.smithi007.stdout: "container_image_loki": { 2023-01-24T21:44:21.906 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "container_image_loki", 2023-01-24T21:44:21.907 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.907 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.907 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.907 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-01-24T21:44:21.907 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.908 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.908 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.908 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Loki container image", 2023-01-24T21:44:21.908 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.908 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.909 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.909 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.909 INFO:tasks.workunit.client.0.smithi007.stdout: "container_image_node_exporter": { 2023-01-24T21:44:21.909 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "container_image_node_exporter", 2023-01-24T21:44:21.909 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.910 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.910 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.910 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.3.1", 2023-01-24T21:44:21.911 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.911 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.911 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.912 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Prometheus container image", 2023-01-24T21:44:21.912 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.913 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.913 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.913 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.914 INFO:tasks.workunit.client.0.smithi007.stdout: "container_image_prometheus": { 2023-01-24T21:44:21.914 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "container_image_prometheus", 2023-01-24T21:44:21.914 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.915 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.915 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.916 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "quay.io/prometheus/prometheus:v2.33.4", 2023-01-24T21:44:21.916 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.916 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.917 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.917 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Prometheus container image", 2023-01-24T21:44:21.917 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.918 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.918 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.918 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.919 INFO:tasks.workunit.client.0.smithi007.stdout: "container_image_promtail": { 2023-01-24T21:44:21.919 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "container_image_promtail", 2023-01-24T21:44:21.919 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.919 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.920 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.920 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-01-24T21:44:21.920 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.920 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.921 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.921 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Promtail container image", 2023-01-24T21:44:21.921 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.921 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.922 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.922 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.922 INFO:tasks.workunit.client.0.smithi007.stdout: "container_image_snmp_gateway": { 2023-01-24T21:44:21.922 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "container_image_snmp_gateway", 2023-01-24T21:44:21.922 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.923 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.923 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.923 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-01-24T21:44:21.923 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.923 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.924 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.924 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "SNMP Gateway container image", 2023-01-24T21:44:21.924 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.925 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.925 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.925 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.926 INFO:tasks.workunit.client.0.smithi007.stdout: "container_init": { 2023-01-24T21:44:21.926 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "container_init", 2023-01-24T21:44:21.926 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:21.927 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.927 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.927 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:21.927 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.927 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.928 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.928 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Run podman/docker with `--init`", 2023-01-24T21:44:21.928 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.928 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.929 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.929 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.929 INFO:tasks.workunit.client.0.smithi007.stdout: "daemon_cache_timeout": { 2023-01-24T21:44:21.929 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "daemon_cache_timeout", 2023-01-24T21:44:21.929 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "secs", 2023-01-24T21:44:21.930 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.930 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.930 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "600", 2023-01-24T21:44:21.930 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.930 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.930 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.931 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-01-24T21:44:21.931 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.931 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.931 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.931 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.932 INFO:tasks.workunit.client.0.smithi007.stdout: "default_registry": { 2023-01-24T21:44:21.932 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "default_registry", 2023-01-24T21:44:21.932 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.933 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.933 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.933 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "docker.io", 2023-01-24T21:44:21.933 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.933 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.934 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.934 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-01-24T21:44:21.934 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.934 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.934 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.935 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.935 INFO:tasks.workunit.client.0.smithi007.stdout: "device_cache_timeout": { 2023-01-24T21:44:21.935 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "device_cache_timeout", 2023-01-24T21:44:21.935 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "secs", 2023-01-24T21:44:21.935 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.936 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.936 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "1800", 2023-01-24T21:44:21.936 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.936 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.936 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.937 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "seconds to cache device inventory", 2023-01-24T21:44:21.937 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.937 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.937 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.937 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.938 INFO:tasks.workunit.client.0.smithi007.stdout: "device_enhanced_scan": { 2023-01-24T21:44:21.938 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "device_enhanced_scan", 2023-01-24T21:44:21.938 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:21.938 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.938 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.939 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:21.939 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.939 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.939 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.939 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Use libstoragemgmt during device scans", 2023-01-24T21:44:21.940 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.940 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.940 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.940 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.940 INFO:tasks.workunit.client.0.smithi007.stdout: "facts_cache_timeout": { 2023-01-24T21:44:21.941 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "facts_cache_timeout", 2023-01-24T21:44:21.941 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "secs", 2023-01-24T21:44:21.941 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.941 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.941 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "60", 2023-01-24T21:44:21.942 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.942 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.942 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.942 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "seconds to cache host facts data", 2023-01-24T21:44:21.942 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.943 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.943 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.943 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.943 INFO:tasks.workunit.client.0.smithi007.stdout: "host_check_interval": { 2023-01-24T21:44:21.944 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "host_check_interval", 2023-01-24T21:44:21.944 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "secs", 2023-01-24T21:44:21.944 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.944 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.945 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "600", 2023-01-24T21:44:21.945 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.945 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.945 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.945 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "how frequently to perform a host check", 2023-01-24T21:44:21.946 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.946 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.946 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.946 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.946 INFO:tasks.workunit.client.0.smithi007.stdout: "log_level": { 2023-01-24T21:44:21.946 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_level", 2023-01-24T21:44:21.947 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.947 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.947 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.947 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:21.947 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.948 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.948 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:21.948 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:21.948 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:21.948 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:21.949 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:21.949 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:21.949 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:21.949 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:21.949 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:21.950 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.950 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.950 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.950 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.950 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster": { 2023-01-24T21:44:21.951 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster", 2023-01-24T21:44:21.951 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:21.951 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.951 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.952 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:21.952 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.952 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.953 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.953 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-01-24T21:44:21.953 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.953 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.954 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.954 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.954 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster_level": { 2023-01-24T21:44:21.954 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster_level", 2023-01-24T21:44:21.955 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.955 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.955 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.955 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "info", 2023-01-24T21:44:21.955 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.956 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.956 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:21.956 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:21.956 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:21.956 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:21.957 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:21.957 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:21.957 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:21.957 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:21.957 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:21.957 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.958 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.958 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.958 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.958 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_file": { 2023-01-24T21:44:21.958 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_file", 2023-01-24T21:44:21.959 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:21.959 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.959 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:21.959 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:21.959 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.960 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.960 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.960 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:21.960 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.960 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.961 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.961 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.961 INFO:tasks.workunit.client.0.smithi007.stdout: "manage_etc_ceph_ceph_conf": { 2023-01-24T21:44:21.961 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-01-24T21:44:21.961 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:21.962 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.962 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.962 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:21.962 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.962 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.963 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.963 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-01-24T21:44:21.963 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.963 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.963 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.964 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.964 INFO:tasks.workunit.client.0.smithi007.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-01-24T21:44:21.964 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-01-24T21:44:21.964 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.964 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.965 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.965 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "*", 2023-01-24T21:44:21.965 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.965 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.965 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.965 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-01-24T21:44:21.966 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.966 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.966 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.966 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.966 INFO:tasks.workunit.client.0.smithi007.stdout: "max_count_per_host": { 2023-01-24T21:44:21.967 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "max_count_per_host", 2023-01-24T21:44:21.967 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "int", 2023-01-24T21:44:21.967 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.967 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.967 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "10", 2023-01-24T21:44:21.968 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.968 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.968 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.968 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "max number of daemons per service per host", 2023-01-24T21:44:21.968 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.969 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.969 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.969 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.969 INFO:tasks.workunit.client.0.smithi007.stdout: "max_osd_draining_count": { 2023-01-24T21:44:21.969 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "max_osd_draining_count", 2023-01-24T21:44:21.970 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "int", 2023-01-24T21:44:21.970 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.970 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.970 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "10", 2023-01-24T21:44:21.970 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.971 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.971 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.971 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-01-24T21:44:21.971 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.971 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.971 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.972 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.972 INFO:tasks.workunit.client.0.smithi007.stdout: "migration_current": { 2023-01-24T21:44:21.972 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "migration_current", 2023-01-24T21:44:21.972 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "int", 2023-01-24T21:44:21.972 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.973 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.973 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:21.973 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.973 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.973 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.974 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "internal - do not modify", 2023-01-24T21:44:21.974 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.974 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.974 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.974 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.975 INFO:tasks.workunit.client.0.smithi007.stdout: "mode": { 2023-01-24T21:44:21.975 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "mode", 2023-01-24T21:44:21.975 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.975 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.975 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.976 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "root", 2023-01-24T21:44:21.976 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.976 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.976 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:21.976 INFO:tasks.workunit.client.0.smithi007.stdout: "cephadm-package", 2023-01-24T21:44:21.977 INFO:tasks.workunit.client.0.smithi007.stdout: "root" 2023-01-24T21:44:21.977 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:21.977 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "mode for remote execution of cephadm", 2023-01-24T21:44:21.977 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.977 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.978 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.978 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.978 INFO:tasks.workunit.client.0.smithi007.stdout: "prometheus_alerts_path": { 2023-01-24T21:44:21.978 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "prometheus_alerts_path", 2023-01-24T21:44:21.978 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.979 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.979 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.979 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-01-24T21:44:21.979 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.979 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.979 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.980 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-01-24T21:44:21.980 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.980 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.980 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.980 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.981 INFO:tasks.workunit.client.0.smithi007.stdout: "registry_insecure": { 2023-01-24T21:44:21.981 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "registry_insecure", 2023-01-24T21:44:21.981 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:21.981 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.981 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.982 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:21.982 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.982 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.982 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.982 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-01-24T21:44:21.983 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.983 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.983 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.983 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.983 INFO:tasks.workunit.client.0.smithi007.stdout: "registry_password": { 2023-01-24T21:44:21.984 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "registry_password", 2023-01-24T21:44:21.984 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.984 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.984 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.984 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:21.985 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.985 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.985 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.985 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-01-24T21:44:21.985 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.985 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.986 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.986 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.986 INFO:tasks.workunit.client.0.smithi007.stdout: "registry_url": { 2023-01-24T21:44:21.986 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "registry_url", 2023-01-24T21:44:21.986 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.987 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.987 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.987 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:21.987 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.988 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.988 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.988 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-01-24T21:44:21.988 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.988 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.988 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.989 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.989 INFO:tasks.workunit.client.0.smithi007.stdout: "registry_username": { 2023-01-24T21:44:21.989 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "registry_username", 2023-01-24T21:44:21.989 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.989 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.990 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.990 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:21.990 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.990 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.990 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.991 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-01-24T21:44:21.991 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.991 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.991 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.991 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.992 INFO:tasks.workunit.client.0.smithi007.stdout: "ssh_config_file": { 2023-01-24T21:44:21.992 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ssh_config_file", 2023-01-24T21:44:21.992 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:21.992 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.992 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.993 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:21.993 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.993 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.993 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.993 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-01-24T21:44:21.994 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.994 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.994 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.994 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.994 INFO:tasks.workunit.client.0.smithi007.stdout: "use_agent": { 2023-01-24T21:44:21.995 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "use_agent", 2023-01-24T21:44:21.995 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:21.995 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.995 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.995 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:21.996 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.996 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.996 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.996 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-01-24T21:44:21.996 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.997 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.997 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:21.997 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:21.997 INFO:tasks.workunit.client.0.smithi007.stdout: "use_repo_digest": { 2023-01-24T21:44:21.997 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "use_repo_digest", 2023-01-24T21:44:21.997 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:21.998 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:21.998 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:21.998 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:21.998 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:21.998 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:21.999 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:21.999 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-01-24T21:44:21.999 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:21.999 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:21.999 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.000 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.000 INFO:tasks.workunit.client.0.smithi007.stdout: "warn_on_failed_host_check": { 2023-01-24T21:44:22.000 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "warn_on_failed_host_check", 2023-01-24T21:44:22.000 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.000 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.001 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.001 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:22.001 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.001 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.001 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.002 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "raise a health warning if the host check fails", 2023-01-24T21:44:22.002 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.002 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.002 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.002 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.003 INFO:tasks.workunit.client.0.smithi007.stdout: "warn_on_stray_daemons": { 2023-01-24T21:44:22.003 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "warn_on_stray_daemons", 2023-01-24T21:44:22.003 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.003 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.003 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.004 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:22.004 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.004 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.004 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.004 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-01-24T21:44:22.005 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.005 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.005 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.005 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.005 INFO:tasks.workunit.client.0.smithi007.stdout: "warn_on_stray_hosts": { 2023-01-24T21:44:22.005 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "warn_on_stray_hosts", 2023-01-24T21:44:22.006 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.006 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.006 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.006 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:22.006 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.007 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.007 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.007 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-01-24T21:44:22.007 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.007 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.008 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.008 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:22.008 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:22.008 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.008 INFO:tasks.workunit.client.0.smithi007.stdout: { 2023-01-24T21:44:22.009 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "crash", 2023-01-24T21:44:22.009 INFO:tasks.workunit.client.0.smithi007.stdout: "can_run": true, 2023-01-24T21:44:22.009 INFO:tasks.workunit.client.0.smithi007.stdout: "error_string": "", 2023-01-24T21:44:22.009 INFO:tasks.workunit.client.0.smithi007.stdout: "module_options": { 2023-01-24T21:44:22.009 INFO:tasks.workunit.client.0.smithi007.stdout: "log_level": { 2023-01-24T21:44:22.010 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_level", 2023-01-24T21:44:22.010 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.010 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.010 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.010 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.011 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.011 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.011 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:22.011 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:22.011 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:22.012 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:22.012 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:22.012 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:22.012 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:22.012 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:22.013 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.013 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.013 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.013 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.013 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.014 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster": { 2023-01-24T21:44:22.014 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster", 2023-01-24T21:44:22.014 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.014 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.014 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.015 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.015 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.015 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.015 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.015 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.015 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.016 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.016 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.016 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.016 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster_level": { 2023-01-24T21:44:22.016 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster_level", 2023-01-24T21:44:22.017 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.017 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.017 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.017 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "info", 2023-01-24T21:44:22.017 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.018 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.018 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:22.018 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:22.018 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:22.018 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:22.019 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:22.019 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:22.019 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:22.019 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:22.019 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.020 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.020 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.020 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.020 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.020 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_file": { 2023-01-24T21:44:22.021 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_file", 2023-01-24T21:44:22.021 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.021 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.021 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.021 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.022 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.022 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.022 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.022 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.022 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.022 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.023 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.023 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.023 INFO:tasks.workunit.client.0.smithi007.stdout: "retain_interval": { 2023-01-24T21:44:22.023 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "retain_interval", 2023-01-24T21:44:22.023 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "secs", 2023-01-24T21:44:22.024 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.024 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.024 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "31536000", 2023-01-24T21:44:22.024 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.024 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.025 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.025 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "how long to retain crashes before pruning them", 2023-01-24T21:44:22.025 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.025 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.025 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.026 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.026 INFO:tasks.workunit.client.0.smithi007.stdout: "warn_recent_interval": { 2023-01-24T21:44:22.026 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "warn_recent_interval", 2023-01-24T21:44:22.026 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "secs", 2023-01-24T21:44:22.026 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.027 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.027 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "1209600", 2023-01-24T21:44:22.027 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.027 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.027 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.028 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "time interval in which to warn about recent crashes", 2023-01-24T21:44:22.028 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.028 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.028 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.028 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:22.029 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:22.029 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.029 INFO:tasks.workunit.client.0.smithi007.stdout: { 2023-01-24T21:44:22.029 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "dashboard", 2023-01-24T21:44:22.029 INFO:tasks.workunit.client.0.smithi007.stdout: "can_run": true, 2023-01-24T21:44:22.029 INFO:tasks.workunit.client.0.smithi007.stdout: "error_string": "", 2023-01-24T21:44:22.030 INFO:tasks.workunit.client.0.smithi007.stdout: "module_options": { 2023-01-24T21:44:22.030 INFO:tasks.workunit.client.0.smithi007.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-01-24T21:44:22.030 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-01-24T21:44:22.031 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "int", 2023-01-24T21:44:22.031 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.031 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.031 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "10", 2023-01-24T21:44:22.031 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.032 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.032 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.032 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.032 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.032 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.033 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.033 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.033 INFO:tasks.workunit.client.0.smithi007.stdout: "ALERTMANAGER_API_HOST": { 2023-01-24T21:44:22.033 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ALERTMANAGER_API_HOST", 2023-01-24T21:44:22.033 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.034 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.034 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.034 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.034 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.034 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.035 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.035 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.035 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.035 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.035 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.036 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.036 INFO:tasks.workunit.client.0.smithi007.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-01-24T21:44:22.036 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-01-24T21:44:22.036 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.036 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.037 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.037 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:22.037 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.037 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.037 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.038 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.038 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.038 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.038 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.038 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.038 INFO:tasks.workunit.client.0.smithi007.stdout: "AUDIT_API_ENABLED": { 2023-01-24T21:44:22.039 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "AUDIT_API_ENABLED", 2023-01-24T21:44:22.039 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.039 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.039 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.039 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.040 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.040 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.040 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.040 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.040 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.041 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.041 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.041 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.041 INFO:tasks.workunit.client.0.smithi007.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-01-24T21:44:22.041 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-01-24T21:44:22.042 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.042 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.042 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.042 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:22.042 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.043 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.043 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.043 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.043 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.043 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.044 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.044 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.044 INFO:tasks.workunit.client.0.smithi007.stdout: "ENABLE_BROWSABLE_API": { 2023-01-24T21:44:22.044 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ENABLE_BROWSABLE_API", 2023-01-24T21:44:22.044 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.045 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.045 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.045 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:22.045 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.045 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.046 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.046 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.046 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.046 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.046 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.046 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.047 INFO:tasks.workunit.client.0.smithi007.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-01-24T21:44:22.047 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-01-24T21:44:22.047 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.047 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.047 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.048 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:22.048 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.048 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.048 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.048 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.049 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.049 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.049 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.049 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.049 INFO:tasks.workunit.client.0.smithi007.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-01-24T21:44:22.050 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-01-24T21:44:22.050 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.050 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.050 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.050 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:22.051 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.051 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.051 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.051 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.051 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.052 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.052 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.052 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.052 INFO:tasks.workunit.client.0.smithi007.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-01-24T21:44:22.052 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-01-24T21:44:22.053 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.053 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.053 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.053 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:22.053 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.054 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.054 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.054 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.054 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.054 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.054 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.055 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.055 INFO:tasks.workunit.client.0.smithi007.stdout: "FEATURE_TOGGLE_NFS": { 2023-01-24T21:44:22.055 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-01-24T21:44:22.055 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.055 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.056 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.056 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:22.056 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.056 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.056 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.057 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.057 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.057 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.057 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.057 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.058 INFO:tasks.workunit.client.0.smithi007.stdout: "FEATURE_TOGGLE_RBD": { 2023-01-24T21:44:22.058 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-01-24T21:44:22.058 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.058 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.058 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.059 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:22.059 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.059 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.059 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.059 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.060 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.060 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.060 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.060 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.060 INFO:tasks.workunit.client.0.smithi007.stdout: "FEATURE_TOGGLE_RGW": { 2023-01-24T21:44:22.061 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-01-24T21:44:22.061 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.061 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.061 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.061 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:22.061 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.062 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.062 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.062 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.062 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.062 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.063 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.063 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.063 INFO:tasks.workunit.client.0.smithi007.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-01-24T21:44:22.063 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-01-24T21:44:22.063 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.064 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.064 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.064 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.064 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.064 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.065 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.065 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.065 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.065 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.065 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.066 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.066 INFO:tasks.workunit.client.0.smithi007.stdout: "GRAFANA_API_PASSWORD": { 2023-01-24T21:44:22.066 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "GRAFANA_API_PASSWORD", 2023-01-24T21:44:22.066 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.066 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.067 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.067 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "admin", 2023-01-24T21:44:22.067 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.067 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.067 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.067 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.068 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.068 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.068 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.068 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.068 INFO:tasks.workunit.client.0.smithi007.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-01-24T21:44:22.069 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-01-24T21:44:22.069 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.069 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.069 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.069 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:22.070 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.070 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.070 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.070 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.070 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.071 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.071 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.071 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.071 INFO:tasks.workunit.client.0.smithi007.stdout: "GRAFANA_API_URL": { 2023-01-24T21:44:22.071 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "GRAFANA_API_URL", 2023-01-24T21:44:22.072 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.072 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.072 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.072 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.072 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.073 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.073 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.073 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.073 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.073 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.074 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.074 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.074 INFO:tasks.workunit.client.0.smithi007.stdout: "GRAFANA_API_USERNAME": { 2023-01-24T21:44:22.074 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "GRAFANA_API_USERNAME", 2023-01-24T21:44:22.074 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.075 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.075 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.075 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "admin", 2023-01-24T21:44:22.075 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.075 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.076 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.076 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.076 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.076 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.076 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.077 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.077 INFO:tasks.workunit.client.0.smithi007.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-01-24T21:44:22.077 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-01-24T21:44:22.077 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.077 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.078 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.078 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.078 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.078 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.078 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.079 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.079 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.079 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.079 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.079 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.079 INFO:tasks.workunit.client.0.smithi007.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-01-24T21:44:22.080 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-01-24T21:44:22.080 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.080 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.080 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.081 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.081 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.081 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.081 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.081 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.082 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.082 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.082 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.082 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.082 INFO:tasks.workunit.client.0.smithi007.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-01-24T21:44:22.083 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-01-24T21:44:22.083 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.083 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.083 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.083 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:22.083 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.084 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.084 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.084 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.084 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.085 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.085 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.085 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.085 INFO:tasks.workunit.client.0.smithi007.stdout: "ISSUE_TRACKER_API_KEY": { 2023-01-24T21:44:22.085 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-01-24T21:44:22.086 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.086 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.086 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.086 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.086 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.087 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.087 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.087 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.087 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.087 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.088 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.088 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.088 INFO:tasks.workunit.client.0.smithi007.stdout: "PROMETHEUS_API_HOST": { 2023-01-24T21:44:22.088 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "PROMETHEUS_API_HOST", 2023-01-24T21:44:22.088 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.089 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.089 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.089 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.089 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.089 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.090 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.090 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.090 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.090 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.090 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.091 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.091 INFO:tasks.workunit.client.0.smithi007.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-01-24T21:44:22.091 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-01-24T21:44:22.091 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.091 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.092 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.092 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:22.092 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.092 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.092 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.093 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.093 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.093 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.093 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.093 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.094 INFO:tasks.workunit.client.0.smithi007.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-01-24T21:44:22.094 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-01-24T21:44:22.094 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.094 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.094 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.095 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.095 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.095 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.095 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.095 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.096 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.096 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.096 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.096 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.096 INFO:tasks.workunit.client.0.smithi007.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-01-24T21:44:22.097 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-01-24T21:44:22.097 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.097 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.097 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.097 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.098 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.098 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.098 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.098 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.098 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.099 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.099 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.099 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.099 INFO:tasks.workunit.client.0.smithi007.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-01-24T21:44:22.099 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-01-24T21:44:22.100 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.100 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.100 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.100 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:22.100 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.101 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.101 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.101 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.101 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.101 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.102 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.102 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.102 INFO:tasks.workunit.client.0.smithi007.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-01-24T21:44:22.102 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-01-24T21:44:22.102 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.103 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.103 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.103 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:22.103 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.103 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.104 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.104 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.104 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.104 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.104 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.105 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.105 INFO:tasks.workunit.client.0.smithi007.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-01-24T21:44:22.105 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-01-24T21:44:22.105 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.105 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.106 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.106 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.106 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.106 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.106 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.107 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.107 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.107 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.107 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.107 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.108 INFO:tasks.workunit.client.0.smithi007.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-01-24T21:44:22.108 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-01-24T21:44:22.108 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.108 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.108 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.109 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.109 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.109 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.109 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.109 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.110 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.110 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.110 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.110 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.110 INFO:tasks.workunit.client.0.smithi007.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-01-24T21:44:22.111 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-01-24T21:44:22.111 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.111 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.111 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.111 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.112 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.112 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.112 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.112 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.112 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.113 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.113 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.113 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.113 INFO:tasks.workunit.client.0.smithi007.stdout: "PWD_POLICY_ENABLED": { 2023-01-24T21:44:22.113 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "PWD_POLICY_ENABLED", 2023-01-24T21:44:22.114 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.114 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.114 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.114 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:22.114 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.114 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.115 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.115 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.115 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.115 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.115 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.116 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.116 INFO:tasks.workunit.client.0.smithi007.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-01-24T21:44:22.116 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-01-24T21:44:22.116 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.116 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.117 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.117 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-01-24T21:44:22.117 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.117 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.117 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.118 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.118 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.118 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.118 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.118 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.119 INFO:tasks.workunit.client.0.smithi007.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-01-24T21:44:22.119 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-01-24T21:44:22.119 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "int", 2023-01-24T21:44:22.119 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.119 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.120 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "10", 2023-01-24T21:44:22.120 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.120 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.120 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.120 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.121 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.121 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.121 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.121 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.121 INFO:tasks.workunit.client.0.smithi007.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-01-24T21:44:22.122 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-01-24T21:44:22.122 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "int", 2023-01-24T21:44:22.122 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.122 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.122 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "8", 2023-01-24T21:44:22.123 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.123 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.123 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.123 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.123 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.123 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.124 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.124 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.124 INFO:tasks.workunit.client.0.smithi007.stdout: "REST_REQUESTS_TIMEOUT": { 2023-01-24T21:44:22.124 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-01-24T21:44:22.124 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "int", 2023-01-24T21:44:22.125 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.125 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.125 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "45", 2023-01-24T21:44:22.125 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.125 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.126 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.126 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.126 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.126 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.126 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.127 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.127 INFO:tasks.workunit.client.0.smithi007.stdout: "RGW_API_ACCESS_KEY": { 2023-01-24T21:44:22.127 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "RGW_API_ACCESS_KEY", 2023-01-24T21:44:22.127 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.127 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.128 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.128 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.128 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.128 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.128 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.129 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.129 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.129 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.129 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.129 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.130 INFO:tasks.workunit.client.0.smithi007.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-01-24T21:44:22.130 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-01-24T21:44:22.130 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.130 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.130 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.131 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "admin", 2023-01-24T21:44:22.131 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.131 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.131 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.131 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.132 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.132 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.132 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.132 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.132 INFO:tasks.workunit.client.0.smithi007.stdout: "RGW_API_SECRET_KEY": { 2023-01-24T21:44:22.133 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "RGW_API_SECRET_KEY", 2023-01-24T21:44:22.133 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.133 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.133 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.133 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.134 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.134 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.134 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.134 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.134 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.135 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.135 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.135 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.135 INFO:tasks.workunit.client.0.smithi007.stdout: "RGW_API_SSL_VERIFY": { 2023-01-24T21:44:22.135 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "RGW_API_SSL_VERIFY", 2023-01-24T21:44:22.136 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.136 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.136 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.136 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:22.136 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.137 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.137 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.137 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.137 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.137 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.138 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.138 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.138 INFO:tasks.workunit.client.0.smithi007.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-01-24T21:44:22.138 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-01-24T21:44:22.138 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "int", 2023-01-24T21:44:22.139 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.139 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.139 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "0", 2023-01-24T21:44:22.139 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.139 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.140 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.140 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.140 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.140 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.140 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.141 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.141 INFO:tasks.workunit.client.0.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-01-24T21:44:22.141 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-01-24T21:44:22.141 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "int", 2023-01-24T21:44:22.141 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.142 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.142 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "10", 2023-01-24T21:44:22.142 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.142 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.142 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.143 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.143 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.143 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.143 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.143 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.144 INFO:tasks.workunit.client.0.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-01-24T21:44:22.144 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-01-24T21:44:22.144 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "int", 2023-01-24T21:44:22.144 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.144 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.145 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "5", 2023-01-24T21:44:22.145 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.145 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.145 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.145 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.146 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.146 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.146 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.146 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.146 INFO:tasks.workunit.client.0.smithi007.stdout: "cross_origin_url": { 2023-01-24T21:44:22.146 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "cross_origin_url", 2023-01-24T21:44:22.147 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.147 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.147 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.147 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.147 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.148 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.148 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.148 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.148 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.148 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.149 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.149 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.149 INFO:tasks.workunit.client.0.smithi007.stdout: "crt_file": { 2023-01-24T21:44:22.149 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "crt_file", 2023-01-24T21:44:22.150 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.150 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.150 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.150 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.150 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.150 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.151 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.151 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.151 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.151 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.151 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.152 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.152 INFO:tasks.workunit.client.0.smithi007.stdout: "debug": { 2023-01-24T21:44:22.152 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "debug", 2023-01-24T21:44:22.152 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.152 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.153 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.153 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.153 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.153 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.153 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.154 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Enable/disable debug options", 2023-01-24T21:44:22.154 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.154 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.154 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.154 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.155 INFO:tasks.workunit.client.0.smithi007.stdout: "jwt_token_ttl": { 2023-01-24T21:44:22.155 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "jwt_token_ttl", 2023-01-24T21:44:22.155 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "int", 2023-01-24T21:44:22.155 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.155 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.156 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "28800", 2023-01-24T21:44:22.156 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.156 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.156 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.156 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.157 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.157 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.157 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.157 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.157 INFO:tasks.workunit.client.0.smithi007.stdout: "key_file": { 2023-01-24T21:44:22.158 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "key_file", 2023-01-24T21:44:22.158 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.158 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.158 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.158 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.159 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.159 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.159 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.159 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.159 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.159 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.160 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.160 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.160 INFO:tasks.workunit.client.0.smithi007.stdout: "log_level": { 2023-01-24T21:44:22.160 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_level", 2023-01-24T21:44:22.160 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.161 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.161 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.161 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.161 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.161 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.162 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:22.162 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:22.162 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:22.162 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:22.162 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:22.163 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:22.163 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:22.163 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:22.163 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.163 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.164 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.164 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.164 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.164 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster": { 2023-01-24T21:44:22.164 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster", 2023-01-24T21:44:22.165 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.165 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.165 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.165 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.165 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.166 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.166 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.166 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.166 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.166 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.167 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.167 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.167 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster_level": { 2023-01-24T21:44:22.167 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster_level", 2023-01-24T21:44:22.167 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.168 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.168 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.168 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "info", 2023-01-24T21:44:22.168 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.168 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.169 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:22.169 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:22.169 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:22.169 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:22.169 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:22.169 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:22.170 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:22.170 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:22.170 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.170 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.170 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.171 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.171 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.171 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_file": { 2023-01-24T21:44:22.171 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_file", 2023-01-24T21:44:22.171 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.172 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.172 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.172 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.172 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.172 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.173 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.173 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.173 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.173 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.173 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.174 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.174 INFO:tasks.workunit.client.0.smithi007.stdout: "motd": { 2023-01-24T21:44:22.174 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "motd", 2023-01-24T21:44:22.174 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.174 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.175 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.175 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.175 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.175 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.175 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.176 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "The message of the day", 2023-01-24T21:44:22.176 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.176 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.176 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.176 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.177 INFO:tasks.workunit.client.0.smithi007.stdout: "redirect_resolve_ip_addr": { 2023-01-24T21:44:22.177 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "redirect_resolve_ip_addr", 2023-01-24T21:44:22.177 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.177 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.177 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.178 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.178 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.178 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.178 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.178 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.179 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.179 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.179 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.179 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.179 INFO:tasks.workunit.client.0.smithi007.stdout: "server_addr": { 2023-01-24T21:44:22.180 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "server_addr", 2023-01-24T21:44:22.180 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.180 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.180 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.180 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "::", 2023-01-24T21:44:22.181 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.181 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.181 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.181 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.181 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.182 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.182 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.182 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.182 INFO:tasks.workunit.client.0.smithi007.stdout: "server_port": { 2023-01-24T21:44:22.182 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "server_port", 2023-01-24T21:44:22.183 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "int", 2023-01-24T21:44:22.183 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.183 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.183 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "8080", 2023-01-24T21:44:22.183 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.184 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.184 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.184 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.184 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.184 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.185 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.185 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.185 INFO:tasks.workunit.client.0.smithi007.stdout: "ssl": { 2023-01-24T21:44:22.185 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ssl", 2023-01-24T21:44:22.185 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.186 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.186 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.186 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:22.186 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.186 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.186 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.187 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.187 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.187 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.187 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.187 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.188 INFO:tasks.workunit.client.0.smithi007.stdout: "ssl_server_port": { 2023-01-24T21:44:22.188 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ssl_server_port", 2023-01-24T21:44:22.188 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "int", 2023-01-24T21:44:22.188 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.188 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.189 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "8443", 2023-01-24T21:44:22.189 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.189 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.189 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.189 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.190 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.190 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.190 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.190 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.190 INFO:tasks.workunit.client.0.smithi007.stdout: "standby_behaviour": { 2023-01-24T21:44:22.191 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "standby_behaviour", 2023-01-24T21:44:22.191 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.191 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.191 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.191 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "redirect", 2023-01-24T21:44:22.192 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.192 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.192 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:22.192 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:22.192 INFO:tasks.workunit.client.0.smithi007.stdout: "redirect" 2023-01-24T21:44:22.193 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:22.193 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.193 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.193 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.193 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.194 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.194 INFO:tasks.workunit.client.0.smithi007.stdout: "standby_error_status_code": { 2023-01-24T21:44:22.194 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "standby_error_status_code", 2023-01-24T21:44:22.194 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "int", 2023-01-24T21:44:22.194 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.195 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.195 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "500", 2023-01-24T21:44:22.195 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "400", 2023-01-24T21:44:22.195 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "599", 2023-01-24T21:44:22.195 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.196 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.196 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.196 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.196 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.197 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.197 INFO:tasks.workunit.client.0.smithi007.stdout: "url_prefix": { 2023-01-24T21:44:22.197 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "url_prefix", 2023-01-24T21:44:22.197 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.197 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.197 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.198 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.198 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.198 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.198 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.198 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.199 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.199 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.199 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.199 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:22.199 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:22.200 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.200 INFO:tasks.workunit.client.0.smithi007.stdout: { 2023-01-24T21:44:22.200 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "devicehealth", 2023-01-24T21:44:22.200 INFO:tasks.workunit.client.0.smithi007.stdout: "can_run": true, 2023-01-24T21:44:22.200 INFO:tasks.workunit.client.0.smithi007.stdout: "error_string": "", 2023-01-24T21:44:22.201 INFO:tasks.workunit.client.0.smithi007.stdout: "module_options": { 2023-01-24T21:44:22.201 INFO:tasks.workunit.client.0.smithi007.stdout: "enable_monitoring": { 2023-01-24T21:44:22.201 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "enable_monitoring", 2023-01-24T21:44:22.201 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.201 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.202 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.202 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:22.202 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.202 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.202 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.203 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "monitor device health metrics", 2023-01-24T21:44:22.203 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.203 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.203 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.203 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.204 INFO:tasks.workunit.client.0.smithi007.stdout: "log_level": { 2023-01-24T21:44:22.204 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_level", 2023-01-24T21:44:22.204 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.204 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.204 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.205 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.205 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.205 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.205 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:22.205 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:22.206 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:22.206 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:22.206 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:22.206 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:22.206 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:22.207 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:22.207 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.207 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.207 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.207 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.207 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.208 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster": { 2023-01-24T21:44:22.208 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster", 2023-01-24T21:44:22.208 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.208 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.208 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.209 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.209 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.209 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.209 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.209 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.210 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.210 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.210 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.210 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.210 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster_level": { 2023-01-24T21:44:22.211 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster_level", 2023-01-24T21:44:22.211 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.211 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.211 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.211 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "info", 2023-01-24T21:44:22.212 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.212 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.212 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:22.212 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:22.212 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:22.213 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:22.213 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:22.213 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:22.213 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:22.213 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:22.214 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.214 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.214 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.214 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.214 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.215 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_file": { 2023-01-24T21:44:22.215 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_file", 2023-01-24T21:44:22.215 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.215 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.215 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.216 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.216 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.216 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.216 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.216 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.217 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.217 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.217 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.217 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.217 INFO:tasks.workunit.client.0.smithi007.stdout: "mark_out_threshold": { 2023-01-24T21:44:22.218 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "mark_out_threshold", 2023-01-24T21:44:22.218 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "secs", 2023-01-24T21:44:22.218 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.218 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.218 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "2419200", 2023-01-24T21:44:22.219 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.219 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.219 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.219 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-01-24T21:44:22.219 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.220 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.220 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.220 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.220 INFO:tasks.workunit.client.0.smithi007.stdout: "pool_name": { 2023-01-24T21:44:22.220 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "pool_name", 2023-01-24T21:44:22.221 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.221 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.221 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.221 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "device_health_metrics", 2023-01-24T21:44:22.221 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.221 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.222 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.222 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "name of pool in which to store device health metrics", 2023-01-24T21:44:22.222 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.222 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.222 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.223 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.223 INFO:tasks.workunit.client.0.smithi007.stdout: "retention_period": { 2023-01-24T21:44:22.223 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "retention_period", 2023-01-24T21:44:22.223 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "secs", 2023-01-24T21:44:22.223 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.224 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.224 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "15552000", 2023-01-24T21:44:22.224 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.224 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.224 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.225 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "how long to retain device health metrics", 2023-01-24T21:44:22.225 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.225 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.225 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.225 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.226 INFO:tasks.workunit.client.0.smithi007.stdout: "scrape_frequency": { 2023-01-24T21:44:22.226 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "scrape_frequency", 2023-01-24T21:44:22.226 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "secs", 2023-01-24T21:44:22.226 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.226 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.227 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "86400", 2023-01-24T21:44:22.227 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.227 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.227 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.227 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "how frequently to scrape device health metrics", 2023-01-24T21:44:22.228 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.228 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.228 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.228 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.228 INFO:tasks.workunit.client.0.smithi007.stdout: "self_heal": { 2023-01-24T21:44:22.229 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "self_heal", 2023-01-24T21:44:22.229 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.229 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.229 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.229 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "True", 2023-01-24T21:44:22.230 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.230 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.230 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.230 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-01-24T21:44:22.230 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.230 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.231 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.231 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.231 INFO:tasks.workunit.client.0.smithi007.stdout: "sleep_interval": { 2023-01-24T21:44:22.231 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "sleep_interval", 2023-01-24T21:44:22.231 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "secs", 2023-01-24T21:44:22.232 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.232 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.232 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "600", 2023-01-24T21:44:22.232 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.232 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.233 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.233 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "how frequently to wake up and check device health", 2023-01-24T21:44:22.233 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.233 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.233 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.234 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.234 INFO:tasks.workunit.client.0.smithi007.stdout: "warn_threshold": { 2023-01-24T21:44:22.234 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "warn_threshold", 2023-01-24T21:44:22.234 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "secs", 2023-01-24T21:44:22.234 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.235 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.235 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "7257600", 2023-01-24T21:44:22.235 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.235 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.235 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.236 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-01-24T21:44:22.236 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.236 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.236 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.236 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:22.237 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:22.237 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.237 INFO:tasks.workunit.client.0.smithi007.stdout: { 2023-01-24T21:44:22.237 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "diskprediction_local", 2023-01-24T21:44:22.237 INFO:tasks.workunit.client.0.smithi007.stdout: "can_run": true, 2023-01-24T21:44:22.237 INFO:tasks.workunit.client.0.smithi007.stdout: "error_string": "", 2023-01-24T21:44:22.238 INFO:tasks.workunit.client.0.smithi007.stdout: "module_options": { 2023-01-24T21:44:22.238 INFO:tasks.workunit.client.0.smithi007.stdout: "log_level": { 2023-01-24T21:44:22.238 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_level", 2023-01-24T21:44:22.238 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.238 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.239 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.239 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.239 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.239 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.239 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:22.240 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:22.240 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:22.240 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:22.240 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:22.240 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:22.241 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:22.241 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:22.241 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.241 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.241 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.242 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.242 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.242 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster": { 2023-01-24T21:44:22.242 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster", 2023-01-24T21:44:22.242 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.243 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.243 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.243 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.243 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.243 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.243 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.244 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.244 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.244 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.244 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.244 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.245 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster_level": { 2023-01-24T21:44:22.245 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster_level", 2023-01-24T21:44:22.245 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.245 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.245 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.246 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "info", 2023-01-24T21:44:22.246 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.246 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.246 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:22.246 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:22.247 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:22.247 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:22.247 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:22.247 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:22.247 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:22.248 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:22.248 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.248 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.248 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.248 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.249 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.249 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_file": { 2023-01-24T21:44:22.249 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_file", 2023-01-24T21:44:22.249 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.249 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.250 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.250 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.250 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.250 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.250 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.250 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.251 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.251 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.251 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.251 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.251 INFO:tasks.workunit.client.0.smithi007.stdout: "predict_interval": { 2023-01-24T21:44:22.252 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "predict_interval", 2023-01-24T21:44:22.252 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.252 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.252 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.252 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "86400", 2023-01-24T21:44:22.253 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.253 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.253 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.253 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.253 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.254 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.254 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.254 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.254 INFO:tasks.workunit.client.0.smithi007.stdout: "predictor_model": { 2023-01-24T21:44:22.254 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "predictor_model", 2023-01-24T21:44:22.255 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.255 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.255 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.255 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "prophetstor", 2023-01-24T21:44:22.255 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.256 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.256 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.256 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.256 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.256 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.257 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.257 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.257 INFO:tasks.workunit.client.0.smithi007.stdout: "sleep_interval": { 2023-01-24T21:44:22.257 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "sleep_interval", 2023-01-24T21:44:22.257 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.258 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.258 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.258 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "600", 2023-01-24T21:44:22.258 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.258 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.259 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.259 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.259 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.259 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.259 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.259 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:22.260 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:22.260 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.260 INFO:tasks.workunit.client.0.smithi007.stdout: { 2023-01-24T21:44:22.260 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "influx", 2023-01-24T21:44:22.260 INFO:tasks.workunit.client.0.smithi007.stdout: "can_run": false, 2023-01-24T21:44:22.261 INFO:tasks.workunit.client.0.smithi007.stdout: "error_string": "influxdb python module not found", 2023-01-24T21:44:22.261 INFO:tasks.workunit.client.0.smithi007.stdout: "module_options": { 2023-01-24T21:44:22.261 INFO:tasks.workunit.client.0.smithi007.stdout: "batch_size": { 2023-01-24T21:44:22.261 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "batch_size", 2023-01-24T21:44:22.261 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "int", 2023-01-24T21:44:22.262 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.262 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.262 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "5000", 2023-01-24T21:44:22.262 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.262 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.263 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.263 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-01-24T21:44:22.263 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.263 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.263 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.264 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.264 INFO:tasks.workunit.client.0.smithi007.stdout: "database": { 2023-01-24T21:44:22.264 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "database", 2023-01-24T21:44:22.264 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.264 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.265 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.265 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "ceph", 2023-01-24T21:44:22.265 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.265 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.265 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.266 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-01-24T21:44:22.266 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.266 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.266 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.266 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.267 INFO:tasks.workunit.client.0.smithi007.stdout: "hostname": { 2023-01-24T21:44:22.267 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "hostname", 2023-01-24T21:44:22.267 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.267 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.267 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.268 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.268 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.268 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.268 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.268 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "InfluxDB server hostname", 2023-01-24T21:44:22.269 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.269 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.269 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.269 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.269 INFO:tasks.workunit.client.0.smithi007.stdout: "interval": { 2023-01-24T21:44:22.270 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "interval", 2023-01-24T21:44:22.270 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "secs", 2023-01-24T21:44:22.270 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.270 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.270 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "30", 2023-01-24T21:44:22.271 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "5", 2023-01-24T21:44:22.271 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.271 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.271 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-01-24T21:44:22.271 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.272 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.272 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.272 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.272 INFO:tasks.workunit.client.0.smithi007.stdout: "log_level": { 2023-01-24T21:44:22.273 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_level", 2023-01-24T21:44:22.273 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.273 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.273 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.273 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.274 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.274 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.274 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:22.274 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:22.274 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:22.275 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:22.275 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:22.275 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:22.275 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:22.275 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:22.276 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.276 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.276 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.276 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.277 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.277 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster": { 2023-01-24T21:44:22.277 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster", 2023-01-24T21:44:22.277 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.277 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.278 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.278 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.278 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.278 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.278 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.279 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.279 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.279 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.279 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.279 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.279 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster_level": { 2023-01-24T21:44:22.280 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster_level", 2023-01-24T21:44:22.280 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.280 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.280 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.280 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "info", 2023-01-24T21:44:22.281 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.281 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.281 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:22.281 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:22.281 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:22.282 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:22.282 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:22.282 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:22.282 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:22.282 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:22.283 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.283 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.283 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.283 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.283 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.284 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_file": { 2023-01-24T21:44:22.284 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_file", 2023-01-24T21:44:22.284 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.284 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.284 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.285 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.285 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.285 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.285 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.285 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.286 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.286 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.286 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.286 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.286 INFO:tasks.workunit.client.0.smithi007.stdout: "password": { 2023-01-24T21:44:22.287 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "password", 2023-01-24T21:44:22.287 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.287 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.287 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.287 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.287 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.288 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.288 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.288 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "password of InfluxDB server user", 2023-01-24T21:44:22.288 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.289 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.289 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.289 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.289 INFO:tasks.workunit.client.0.smithi007.stdout: "port": { 2023-01-24T21:44:22.289 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "port", 2023-01-24T21:44:22.289 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "int", 2023-01-24T21:44:22.290 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.290 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.290 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "8086", 2023-01-24T21:44:22.290 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.290 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.291 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.291 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "InfluxDB server port", 2023-01-24T21:44:22.291 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.291 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.291 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.292 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.292 INFO:tasks.workunit.client.0.smithi007.stdout: "ssl": { 2023-01-24T21:44:22.292 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ssl", 2023-01-24T21:44:22.292 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.292 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.293 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.293 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "false", 2023-01-24T21:44:22.293 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.293 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.293 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.294 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-01-24T21:44:22.294 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.294 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.294 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.294 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.295 INFO:tasks.workunit.client.0.smithi007.stdout: "threads": { 2023-01-24T21:44:22.295 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "threads", 2023-01-24T21:44:22.295 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "int", 2023-01-24T21:44:22.295 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.295 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.296 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "5", 2023-01-24T21:44:22.296 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "1", 2023-01-24T21:44:22.296 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "32", 2023-01-24T21:44:22.296 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.296 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-01-24T21:44:22.297 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.297 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.297 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.297 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.297 INFO:tasks.workunit.client.0.smithi007.stdout: "username": { 2023-01-24T21:44:22.298 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "username", 2023-01-24T21:44:22.298 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.298 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.298 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.298 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.298 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.299 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.299 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.299 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "username of InfluxDB server user", 2023-01-24T21:44:22.299 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.300 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.300 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.300 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.300 INFO:tasks.workunit.client.0.smithi007.stdout: "verify_ssl": { 2023-01-24T21:44:22.300 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "verify_ssl", 2023-01-24T21:44:22.301 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.301 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.301 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 0, 2023-01-24T21:44:22.301 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "true", 2023-01-24T21:44:22.301 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.301 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.302 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.302 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-01-24T21:44:22.302 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.302 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.302 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.303 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:22.303 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:22.303 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.303 INFO:tasks.workunit.client.0.smithi007.stdout: { 2023-01-24T21:44:22.303 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "insights", 2023-01-24T21:44:22.304 INFO:tasks.workunit.client.0.smithi007.stdout: "can_run": true, 2023-01-24T21:44:22.304 INFO:tasks.workunit.client.0.smithi007.stdout: "error_string": "", 2023-01-24T21:44:22.304 INFO:tasks.workunit.client.0.smithi007.stdout: "module_options": { 2023-01-24T21:44:22.304 INFO:tasks.workunit.client.0.smithi007.stdout: "log_level": { 2023-01-24T21:44:22.304 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_level", 2023-01-24T21:44:22.305 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.305 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.305 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.305 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.305 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.306 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.306 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:22.306 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:22.306 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:22.306 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:22.307 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:22.307 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:22.307 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:22.307 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:22.307 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.308 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.308 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.308 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.308 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.308 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster": { 2023-01-24T21:44:22.309 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster", 2023-01-24T21:44:22.309 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.309 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.309 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.309 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.310 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.310 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.310 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.310 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.310 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.311 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.311 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.311 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.311 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster_level": { 2023-01-24T21:44:22.311 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster_level", 2023-01-24T21:44:22.311 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.312 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.312 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.312 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "info", 2023-01-24T21:44:22.312 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.312 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.313 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:22.313 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:22.313 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:22.313 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:22.313 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:22.314 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:22.314 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:22.314 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:22.314 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.314 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.315 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.315 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.315 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.315 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_file": { 2023-01-24T21:44:22.315 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_file", 2023-01-24T21:44:22.316 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.316 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.316 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.316 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.316 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.317 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.317 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.317 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.317 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.317 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.318 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.318 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:22.318 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:22.318 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.318 INFO:tasks.workunit.client.0.smithi007.stdout: { 2023-01-24T21:44:22.319 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "iostat", 2023-01-24T21:44:22.319 INFO:tasks.workunit.client.0.smithi007.stdout: "can_run": true, 2023-01-24T21:44:22.319 INFO:tasks.workunit.client.0.smithi007.stdout: "error_string": "", 2023-01-24T21:44:22.319 INFO:tasks.workunit.client.0.smithi007.stdout: "module_options": { 2023-01-24T21:44:22.319 INFO:tasks.workunit.client.0.smithi007.stdout: "log_level": { 2023-01-24T21:44:22.319 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_level", 2023-01-24T21:44:22.320 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.320 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.320 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.320 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.320 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.321 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.321 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:22.321 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:22.321 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:22.321 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:22.322 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:22.322 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:22.322 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:22.322 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:22.322 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.323 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.323 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.323 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.323 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.323 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster": { 2023-01-24T21:44:22.324 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster", 2023-01-24T21:44:22.324 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.324 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.324 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.324 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.325 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.325 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.325 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.325 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.325 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.326 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.326 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.326 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.326 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster_level": { 2023-01-24T21:44:22.326 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster_level", 2023-01-24T21:44:22.326 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.327 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.327 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.327 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "info", 2023-01-24T21:44:22.327 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.327 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.328 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:22.328 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:22.328 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:22.328 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:22.328 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:22.329 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:22.329 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:22.329 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:22.329 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.329 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.330 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.330 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.330 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.330 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_file": { 2023-01-24T21:44:22.330 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_file", 2023-01-24T21:44:22.331 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.331 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.331 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.331 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.331 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.332 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.332 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.332 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.332 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.332 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.333 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.333 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:22.333 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:22.333 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.333 INFO:tasks.workunit.client.0.smithi007.stdout: { 2023-01-24T21:44:22.334 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "localpool", 2023-01-24T21:44:22.334 INFO:tasks.workunit.client.0.smithi007.stdout: "can_run": true, 2023-01-24T21:44:22.334 INFO:tasks.workunit.client.0.smithi007.stdout: "error_string": "", 2023-01-24T21:44:22.334 INFO:tasks.workunit.client.0.smithi007.stdout: "module_options": { 2023-01-24T21:44:22.334 INFO:tasks.workunit.client.0.smithi007.stdout: "failure_domain": { 2023-01-24T21:44:22.335 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "failure_domain", 2023-01-24T21:44:22.335 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.335 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.335 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.335 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "host", 2023-01-24T21:44:22.336 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.336 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.336 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.336 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "failure domain for any created local pool", 2023-01-24T21:44:22.336 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-01-24T21:44:22.337 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.337 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.337 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.337 INFO:tasks.workunit.client.0.smithi007.stdout: "log_level": { 2023-01-24T21:44:22.337 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_level", 2023-01-24T21:44:22.337 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.338 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.338 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.338 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.338 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.338 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.339 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:22.339 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:22.339 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:22.339 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:22.339 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:22.340 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:22.340 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:22.340 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:22.340 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.340 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.341 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.341 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.341 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.341 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster": { 2023-01-24T21:44:22.341 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster", 2023-01-24T21:44:22.342 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.342 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.342 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.342 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.342 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.343 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.343 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.343 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.343 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.343 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.344 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.344 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.344 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster_level": { 2023-01-24T21:44:22.344 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster_level", 2023-01-24T21:44:22.344 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.344 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.345 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.345 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "info", 2023-01-24T21:44:22.345 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.345 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.345 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:22.346 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:22.346 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:22.346 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:22.346 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:22.346 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:22.347 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:22.347 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:22.347 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.347 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.347 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.348 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.348 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.348 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_file": { 2023-01-24T21:44:22.348 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_file", 2023-01-24T21:44:22.348 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.349 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.349 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.349 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.349 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.349 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.350 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.350 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.350 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.350 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.350 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.351 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.351 INFO:tasks.workunit.client.0.smithi007.stdout: "min_size": { 2023-01-24T21:44:22.351 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "min_size", 2023-01-24T21:44:22.351 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "int", 2023-01-24T21:44:22.351 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.352 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.352 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.352 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.352 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.352 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.353 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "default min_size for any created local pool", 2023-01-24T21:44:22.353 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-01-24T21:44:22.353 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.353 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.353 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.354 INFO:tasks.workunit.client.0.smithi007.stdout: "num_rep": { 2023-01-24T21:44:22.354 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "num_rep", 2023-01-24T21:44:22.354 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "int", 2023-01-24T21:44:22.354 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.354 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.355 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "3", 2023-01-24T21:44:22.355 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.355 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.355 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.355 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "default replica count for any created local pool", 2023-01-24T21:44:22.356 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.356 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.356 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.356 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.356 INFO:tasks.workunit.client.0.smithi007.stdout: "pg_num": { 2023-01-24T21:44:22.357 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "pg_num", 2023-01-24T21:44:22.357 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "int", 2023-01-24T21:44:22.357 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.357 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.357 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "128", 2023-01-24T21:44:22.358 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.358 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.358 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.358 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "default pg_num for any created local pool", 2023-01-24T21:44:22.358 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.359 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.359 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.359 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.359 INFO:tasks.workunit.client.0.smithi007.stdout: "prefix": { 2023-01-24T21:44:22.359 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "prefix", 2023-01-24T21:44:22.360 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.360 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.360 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.360 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.361 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.361 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.361 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.361 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "name prefix for any created local pool", 2023-01-24T21:44:22.361 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.361 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.362 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.362 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.362 INFO:tasks.workunit.client.0.smithi007.stdout: "subtree": { 2023-01-24T21:44:22.362 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "subtree", 2023-01-24T21:44:22.362 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.363 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.363 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.363 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "rack", 2023-01-24T21:44:22.363 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.363 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.364 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.364 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "CRUSH level for which to create a local pool", 2023-01-24T21:44:22.364 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-01-24T21:44:22.364 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.364 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.365 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:22.365 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:22.365 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.365 INFO:tasks.workunit.client.0.smithi007.stdout: { 2023-01-24T21:44:22.365 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "mds_autoscaler", 2023-01-24T21:44:22.366 INFO:tasks.workunit.client.0.smithi007.stdout: "can_run": true, 2023-01-24T21:44:22.366 INFO:tasks.workunit.client.0.smithi007.stdout: "error_string": "", 2023-01-24T21:44:22.366 INFO:tasks.workunit.client.0.smithi007.stdout: "module_options": { 2023-01-24T21:44:22.366 INFO:tasks.workunit.client.0.smithi007.stdout: "log_level": { 2023-01-24T21:44:22.366 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_level", 2023-01-24T21:44:22.367 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.367 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.367 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.367 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.367 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.368 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.368 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:22.368 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:22.368 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:22.368 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:22.369 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:22.369 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:22.369 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:22.369 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:22.369 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.369 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.370 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.370 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.370 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.370 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster": { 2023-01-24T21:44:22.370 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster", 2023-01-24T21:44:22.371 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.371 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.371 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.371 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.371 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.372 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.372 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.372 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.372 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.372 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.373 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.373 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.373 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster_level": { 2023-01-24T21:44:22.373 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster_level", 2023-01-24T21:44:22.373 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.374 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.374 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.374 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "info", 2023-01-24T21:44:22.374 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.374 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.375 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:22.375 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:22.375 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:22.375 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:22.375 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:22.376 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:22.376 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:22.376 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:22.376 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.376 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.377 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.377 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.377 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.377 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_file": { 2023-01-24T21:44:22.377 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_file", 2023-01-24T21:44:22.378 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.378 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.378 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.378 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.378 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.378 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.379 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.379 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.379 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.379 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.379 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.380 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:22.380 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:22.380 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.380 INFO:tasks.workunit.client.0.smithi007.stdout: { 2023-01-24T21:44:22.380 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "mirroring", 2023-01-24T21:44:22.381 INFO:tasks.workunit.client.0.smithi007.stdout: "can_run": true, 2023-01-24T21:44:22.381 INFO:tasks.workunit.client.0.smithi007.stdout: "error_string": "", 2023-01-24T21:44:22.381 INFO:tasks.workunit.client.0.smithi007.stdout: "module_options": { 2023-01-24T21:44:22.381 INFO:tasks.workunit.client.0.smithi007.stdout: "log_level": { 2023-01-24T21:44:22.381 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_level", 2023-01-24T21:44:22.382 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.382 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.382 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.382 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.382 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.383 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.383 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:22.383 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:22.383 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:22.383 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:22.384 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:22.384 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:22.384 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:22.384 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:22.384 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.384 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.385 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.385 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.385 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.385 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster": { 2023-01-24T21:44:22.385 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster", 2023-01-24T21:44:22.386 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.386 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.386 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.386 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.386 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.387 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.387 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.387 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.387 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.387 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.388 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.388 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.388 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster_level": { 2023-01-24T21:44:22.388 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster_level", 2023-01-24T21:44:22.388 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.389 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.389 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.389 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "info", 2023-01-24T21:44:22.389 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.389 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.390 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:22.390 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:22.390 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:22.390 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:22.390 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:22.391 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:22.391 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:22.391 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:22.391 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.391 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.392 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.392 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.392 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.392 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_file": { 2023-01-24T21:44:22.392 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_file", 2023-01-24T21:44:22.393 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.393 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.393 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.393 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.393 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.394 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.394 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.394 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.394 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.394 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.395 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.395 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:22.395 INFO:tasks.workunit.client.0.smithi007.stdout: } 2023-01-24T21:44:22.395 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.395 INFO:tasks.workunit.client.0.smithi007.stdout: { 2023-01-24T21:44:22.396 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "nfs", 2023-01-24T21:44:22.396 INFO:tasks.workunit.client.0.smithi007.stdout: "can_run": true, 2023-01-24T21:44:22.396 INFO:tasks.workunit.client.0.smithi007.stdout: "error_string": "", 2023-01-24T21:44:22.396 INFO:tasks.workunit.client.0.smithi007.stdout: "module_options": { 2023-01-24T21:44:22.396 INFO:tasks.workunit.client.0.smithi007.stdout: "log_level": { 2023-01-24T21:44:22.397 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_level", 2023-01-24T21:44:22.397 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.397 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.397 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.397 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "", 2023-01-24T21:44:22.398 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.398 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.398 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:22.398 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:22.398 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:22.399 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:22.399 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:22.399 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:22.399 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:22.399 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:22.400 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.400 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.400 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.400 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.400 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.401 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster": { 2023-01-24T21:44:22.401 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster", 2023-01-24T21:44:22.401 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.401 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.401 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.402 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.402 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.402 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.402 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [], 2023-01-24T21:44:22.402 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.403 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.403 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.403 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.403 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.403 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_cluster_level": { 2023-01-24T21:44:22.404 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_cluster_level", 2023-01-24T21:44:22.404 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "str", 2023-01-24T21:44:22.404 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.404 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.404 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "info", 2023-01-24T21:44:22.405 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.405 INFO:tasks.workunit.client.0.smithi007.stdout: "max": "", 2023-01-24T21:44:22.405 INFO:tasks.workunit.client.0.smithi007.stdout: "enum_allowed": [ 2023-01-24T21:44:22.405 INFO:tasks.workunit.client.0.smithi007.stdout: "", 2023-01-24T21:44:22.405 INFO:tasks.workunit.client.0.smithi007.stdout: "critical", 2023-01-24T21:44:22.406 INFO:tasks.workunit.client.0.smithi007.stdout: "debug", 2023-01-24T21:44:22.406 INFO:tasks.workunit.client.0.smithi007.stdout: "error", 2023-01-24T21:44:22.406 INFO:tasks.workunit.client.0.smithi007.stdout: "info", 2023-01-24T21:44:22.406 INFO:tasks.workunit.client.0.smithi007.stdout: "warning" 2023-01-24T21:44:22.406 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2023-01-24T21:44:22.406 INFO:tasks.workunit.client.0.smithi007.stdout: "desc": "", 2023-01-24T21:44:22.407 INFO:tasks.workunit.client.0.smithi007.stdout: "long_desc": "", 2023-01-24T21:44:22.407 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2023-01-24T21:44:22.407 INFO:tasks.workunit.client.0.smithi007.stdout: "see_also": [] 2023-01-24T21:44:22.407 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2023-01-24T21:44:22.407 INFO:tasks.workunit.client.0.smithi007.stdout: "log_to_file": { 2023-01-24T21:44:22.408 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "log_to_file", 2023-01-24T21:44:22.408 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "bool", 2023-01-24T21:44:22.408 INFO:tasks.workunit.client.0.smithi007.stdout: "level": "advanced", 2023-01-24T21:44:22.408 INFO:tasks.workunit.client.0.smithi007.stdout: "flags": 1, 2023-01-24T21:44:22.408 INFO:tasks.workunit.client.0.smithi007.stdout: "default_value": "False", 2023-01-24T21:44:22.409 INFO:tasks.workunit.client.0.smithi007.stdout: "min": "", 2023-01-24T21:44:22.409 INFO:tasks.workunit.client.0.smithi007.stdout: