2023-01-25T06:06:24.327 INFO:root:teuthology version: 0.0.1.dev22+g8e1bba1 2023-01-25T06:06:24.328 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi/7136899 --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} --verbose --owner scheduled_yuriw@teuthology --name yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi -- /home/teuthworker/archive/yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi/7136899/orig.config.yaml 2023-01-25T06:06:24.372 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-01-25T06:06:24.439 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi/7136899 branch: wip-yuri2-testing-2023-01-23-0928 description: rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} email: yweinstein@radhat.com first_in_suite: false job_id: '7136899' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 30 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-yuri2-testing-2023-01-23-0928 ceph: conf: global: mon election default strategy: 1 ms type: async osd debug inject dispatch delay duration: 0.1 osd debug inject dispatch delay probability: 0.1 osd_pool_default_min_size: 2 osd_pool_default_size: 2 osd_recovery_max_active: 10 osd_recovery_max_single_start: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 paxos service trim min: 10 osd: bluestore zero block detection: true debug ms: 1 debug osd: 20 osd backoff on degraded: true osd backoff on peering: true osd blocked scrub grace period: 3600 osd debug verify cached snaps: true osd debug verify missing on start: true osd inject bad map crc probability: 0.1 osd map cache size: 1 osd max backfills: 6 osd max markdown count: 1000 osd mclock override recovery settings: true osd objectstore: filestore osd op queue: debug_random osd op queue cut off: debug_random osd scrub during recovery: false osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd sloppy crc: true osd_max_pg_log_entries: 3000 osd_min_pg_log_entries: 3000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(REQUEST_STUCK\) - failed to encode map - but it is still running - objects unfound and apparently lost - osd_map_cache_size - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - must scrub before tier agent can activate sha1: 61996d73ab738798e4ee0055c86457f5c459da4a ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: osd objectstore: filestore osd sloppy crc: true filestore: true fs: xfs install: ceph: flavor: default sha1: 61996d73ab738798e4ee0055c86457f5c459da4a selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: wip-yuri2-testing-2023-01-23-0928 sha1: 61996d73ab738798e4ee0055c86457f5c459da4a owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: 61996d73ab738798e4ee0055c86457f5c459da4a sleep_before_teardown: 0 suite: rados suite_branch: wip-yuri2-testing-2023-01-23-0928 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_61996d73ab738798e4ee0055c86457f5c459da4a/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 61996d73ab738798e4ee0055c86457f5c459da4a targets: smithi088.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi089.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - install: null - ceph: conf: osd: debug monc: 20 - exec: mon.a: - while ! ceph balancer status ; do sleep 1 ; done - ceph balancer mode crush-compat - ceph balancer on - thrashosds: chance_pgnum_grow: 0.25 chance_pgnum_shrink: 0.25 chance_pgpnum_fix: 0.25 chance_test_map_discontinuity: 2 timeout: 1800 - exec: client.0: - sudo ceph osd pool create base 4 - sudo ceph osd pool application enable base rados - sudo ceph osd pool create cache 4 - sudo ceph osd tier add base cache - sudo ceph osd tier cache-mode cache readproxy - sudo ceph osd tier set-overlay base cache - sudo ceph osd pool set cache hit_set_type bloom - sudo ceph osd pool set cache hit_set_count 8 - sudo ceph osd pool set cache hit_set_period 3600 - sudo ceph osd pool set cache target_max_objects 250 - rados: clients: - client.0 objects: 500 op_weights: cache_evict: 50 cache_flush: 50 cache_try_flush: 50 copy_from: 50 delete: 50 read: 100 rollback: 50 snap_create: 50 snap_remove: 50 write: 100 ops: 4000 pool_snaps: true pools: - base teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8e1bba12e584b7ae912e92e94afe9c075ab51fa3 timestamp: 2023-01-24_22:22:09 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.17735 2023-01-25T06:06:24.439 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_61996d73ab738798e4ee0055c86457f5c459da4a/qa; will attempt to use it 2023-01-25T06:06:24.440 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_61996d73ab738798e4ee0055c86457f5c459da4a/qa/tasks 2023-01-25T06:06:24.441 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-01-25T06:06:24.442 INFO:teuthology.task.internal:Checking packages... 2023-01-25T06:06:24.471 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '61996d73ab738798e4ee0055c86457f5c459da4a' 2023-01-25T06:06:24.471 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-01-25T06:06:24.472 INFO:teuthology.packaging:ref: None 2023-01-25T06:06:24.472 INFO:teuthology.packaging:tag: None 2023-01-25T06:06:24.472 INFO:teuthology.packaging:branch: wip-yuri2-testing-2023-01-23-0928 2023-01-25T06:06:24.473 INFO:teuthology.packaging:sha1: 61996d73ab738798e4ee0055c86457f5c459da4a 2023-01-25T06:06:24.473 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri2-testing-2023-01-23-0928 2023-01-25T06:06:24.618 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-1963.g61996d73 2023-01-25T06:06:24.618 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-01-25T06:06:24.625 INFO:teuthology.task.internal:no buildpackages task found 2023-01-25T06:06:24.625 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-01-25T06:06:24.639 INFO:teuthology.task.internal:Saving configuration 2023-01-25T06:06:24.657 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-01-25T06:06:24.663 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-01-25T06:06:24.686 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi/7136899', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-25 06:01:29.421002', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-01-25T06:06:24.707 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi/7136899', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-25 06:01:29.419375', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-01-25T06:06:24.708 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-01-25T06:06:24.714 INFO:teuthology.task.internal:roles: ubuntu@smithi088.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2023-01-25T06:06:24.714 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-01-25T06:06:24.715 INFO:teuthology.run_tasks:Running task console_log... 2023-01-25T06:06:24.778 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbfcd860670>, signals=[15]) 2023-01-25T06:06:24.779 INFO:teuthology.run_tasks:Running task internal.connect... 2023-01-25T06:06:24.785 INFO:teuthology.task.internal:Opening connections... 2023-01-25T06:06:24.785 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi088.front.sepia.ceph.com 2023-01-25T06:06:24.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T06:06:24.850 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2023-01-25T06:06:24.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T06:06:24.918 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-01-25T06:06:24.924 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2023-01-25T06:06:24.942 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2023-01-25T06:06:24.943 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-01-25T06:06:24.995 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Red Hat Enterprise Linux" 2023-01-25T06:06:24.996 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8.6 (Ootpa)" 2023-01-25T06:06:24.996 INFO:teuthology.orchestra.run.smithi088.stdout:ID="rhel" 2023-01-25T06:06:24.996 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="fedora" 2023-01-25T06:06:24.996 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8.6" 2023-01-25T06:06:24.996 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2023-01-25T06:06:24.997 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-01-25T06:06:24.997 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2023-01-25T06:06:24.997 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-01-25T06:06:24.997 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.redhat.com/" 2023-01-25T06:06:24.997 INFO:teuthology.orchestra.run.smithi088.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-01-25T06:06:24.997 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-01-25T06:06:24.998 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:06:24.998 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-01-25T06:06:24.998 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-01-25T06:06:24.998 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-01-25T06:06:24.998 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-01-25T06:06:24.999 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-01-25T06:06:25.016 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2023-01-25T06:06:25.037 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2023-01-25T06:06:25.037 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-01-25T06:06:25.095 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="Red Hat Enterprise Linux" 2023-01-25T06:06:25.096 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="8.6 (Ootpa)" 2023-01-25T06:06:25.096 INFO:teuthology.orchestra.run.smithi089.stdout:ID="rhel" 2023-01-25T06:06:25.096 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="fedora" 2023-01-25T06:06:25.096 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="8.6" 2023-01-25T06:06:25.096 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el8" 2023-01-25T06:06:25.097 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-01-25T06:06:25.097 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2023-01-25T06:06:25.097 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-01-25T06:06:25.097 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://www.redhat.com/" 2023-01-25T06:06:25.097 INFO:teuthology.orchestra.run.smithi089.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-01-25T06:06:25.098 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-01-25T06:06:25.098 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:06:25.098 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-01-25T06:06:25.098 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-01-25T06:06:25.098 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-01-25T06:06:25.099 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-01-25T06:06:25.099 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-01-25T06:06:25.115 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-01-25T06:06:25.127 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-01-25T06:06:25.133 INFO:teuthology.task.internal:Checking for old test directory... 2023-01-25T06:06:25.133 DEBUG:teuthology.orchestra.run.smithi088:> test '!' -e /home/ubuntu/cephtest 2023-01-25T06:06:25.136 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2023-01-25T06:06:25.154 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-01-25T06:06:25.162 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-01-25T06:06:25.162 DEBUG:teuthology.orchestra.run.smithi088:> test -z $(ls -A /var/lib/ceph) 2023-01-25T06:06:25.189 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2023-01-25T06:06:25.220 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-01-25T06:06:25.272 INFO:teuthology.run_tasks:Running task kernel... 2023-01-25T06:06:25.293 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-01-25T06:06:25.294 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-01-25T06:06:25.294 DEBUG:teuthology.orchestra.run.smithi088:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-25T06:06:25.295 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-25T06:06:25.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T06:06:25.312 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2023-01-25T06:06:25.313 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T06:06:25.314 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2023-01-25T06:06:25.365 INFO:teuthology.orchestra.run.smithi088.stdout:4.18.0-372.9.1.el8.x86_64 2023-01-25T06:06:25.366 INFO:teuthology.task.kernel:Running kernel on smithi088: 4.18.0-372.9.1.el8.x86_64 2023-01-25T06:06:25.366 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum install -y kernel 2023-01-25T06:06:25.373 INFO:teuthology.orchestra.run.smithi089.stdout:4.18.0-372.9.1.el8.x86_64 2023-01-25T06:06:25.373 INFO:teuthology.task.kernel:Running kernel on smithi089: 4.18.0-372.9.1.el8.x86_64 2023-01-25T06:06:25.374 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum install -y kernel 2023-01-25T06:06:26.582 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:06:26.583 INFO:teuthology.orchestra.run.smithi089.stdout:Unable to read consumer identity 2023-01-25T06:06:26.683 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:06:26.683 INFO:teuthology.orchestra.run.smithi088.stdout:Unable to read consumer identity 2023-01-25T06:06:28.030 INFO:teuthology.orchestra.run.smithi089.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-01-25T06:06:28.127 INFO:teuthology.orchestra.run.smithi088.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2023-01-25T06:06:29.198 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 12 MB/s | 13 MB 00:01 2023-01-25T06:06:29.211 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 13 MB/s | 13 MB 00:01 2023-01-25T06:06:32.184 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 533 kB/s | 24 kB 00:00 2023-01-25T06:06:32.211 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 435 kB/s | 24 kB 00:00 2023-01-25T06:06:32.800 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-01-25T06:06:32.831 INFO:teuthology.orchestra.run.smithi088.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-01-25T06:06:32.850 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T06:06:32.851 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-01-25T06:06:32.852 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T06:06:32.887 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T06:06:32.888 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-01-25T06:06:32.889 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T06:06:32.964 DEBUG:teuthology.orchestra.run.smithi089:> echo no | sudo yum reinstall kernel || true 2023-01-25T06:06:33.006 DEBUG:teuthology.orchestra.run.smithi088:> echo no | sudo yum reinstall kernel || true 2023-01-25T06:06:33.293 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:06:33.293 INFO:teuthology.orchestra.run.smithi089.stdout:Unable to read consumer identity 2023-01-25T06:06:33.338 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:06:33.338 INFO:teuthology.orchestra.run.smithi088.stdout:Unable to read consumer identity 2023-01-25T06:06:33.544 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:01 ago on Wed 25 Jan 2023 06:06:32 AM UTC. 2023-01-25T06:06:33.586 INFO:teuthology.orchestra.run.smithi089.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-01-25T06:06:33.588 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:01 ago on Wed 25 Jan 2023 06:06:32 AM UTC. 2023-01-25T06:06:33.615 INFO:teuthology.orchestra.run.smithi089.stderr:Error: No packages marked for reinstall. 2023-01-25T06:06:33.634 INFO:teuthology.orchestra.run.smithi088.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-01-25T06:06:33.661 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum reinstall -y kernel || true 2023-01-25T06:06:33.669 INFO:teuthology.orchestra.run.smithi088.stderr:Error: No packages marked for reinstall. 2023-01-25T06:06:33.714 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum reinstall -y kernel || true 2023-01-25T06:06:33.989 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:06:33.990 INFO:teuthology.orchestra.run.smithi089.stdout:Unable to read consumer identity 2023-01-25T06:06:34.043 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:06:34.043 INFO:teuthology.orchestra.run.smithi088.stdout:Unable to read consumer identity 2023-01-25T06:06:34.235 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:02 ago on Wed 25 Jan 2023 06:06:32 AM UTC. 2023-01-25T06:06:34.275 INFO:teuthology.orchestra.run.smithi089.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-01-25T06:06:34.296 INFO:teuthology.orchestra.run.smithi089.stderr:Error: No packages marked for reinstall. 2023-01-25T06:06:34.298 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:02 ago on Wed 25 Jan 2023 06:06:32 AM UTC. 2023-01-25T06:06:34.338 INFO:teuthology.orchestra.run.smithi088.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-01-25T06:06:34.341 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel --last | head -n 1 2023-01-25T06:06:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:Error: No packages marked for reinstall. 2023-01-25T06:06:34.420 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q kernel --last | head -n 1 2023-01-25T06:06:34.422 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-4.18.0-372.9.1.el8.x86_64 Thu 14 Jul 2022 06:23:21 PM UTC 2023-01-25T06:06:34.423 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-01-25T06:06:34.423 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-01-25T06:06:34.423 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-01-25T06:06:34.424 DEBUG:teuthology.orchestra.run.smithi089:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-01-25T06:06:34.450 INFO:teuthology.orchestra.run.smithi089.stdout:ttyS1 2023-01-25T06:06:34.467 DEBUG:teuthology.parallel:result is None 2023-01-25T06:06:34.503 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-4.18.0-372.9.1.el8.x86_64 Thu 14 Jul 2022 06:23:21 PM UTC 2023-01-25T06:06:34.504 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-01-25T06:06:34.505 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-01-25T06:06:34.505 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-01-25T06:06:34.505 DEBUG:teuthology.orchestra.run.smithi088:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-01-25T06:06:34.531 INFO:teuthology.orchestra.run.smithi088.stdout:ttyS1 2023-01-25T06:06:34.542 DEBUG:teuthology.parallel:result is None 2023-01-25T06:06:34.543 INFO:teuthology.run_tasks:Running task internal.base... 2023-01-25T06:06:34.550 INFO:teuthology.task.internal:Creating test directory... 2023-01-25T06:06:34.551 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-25T06:06:34.584 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-25T06:06:34.601 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-01-25T06:06:34.607 INFO:teuthology.run_tasks:Running task internal.archive... 2023-01-25T06:06:34.613 INFO:teuthology.task.internal:Creating archive directory... 2023-01-25T06:06:34.614 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-25T06:06:34.641 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-25T06:06:34.672 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-01-25T06:06:34.678 INFO:teuthology.task.internal:Enabling coredump saving... 2023-01-25T06:06:34.679 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-25T06:06:34.699 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-25T06:06:34.734 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T06:06:34.744 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T06:06:34.748 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T06:06:34.759 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T06:06:34.760 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-01-25T06:06:34.767 INFO:teuthology.task.internal:Configuring sudo... 2023-01-25T06:06:34.767 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-25T06:06:34.770 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-25T06:06:34.814 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-01-25T06:06:34.823 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-01-25T06:06:34.824 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-25T06:06:34.836 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-25T06:06:34.871 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T06:06:34.930 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T06:06:34.987 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T06:06:35.068 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T06:06:35.112 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-01-25T06:06:35.113 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-25T06:06:35.179 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T06:06:35.219 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T06:06:35.270 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T06:06:35.349 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T06:06:35.394 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-01-25T06:06:35.394 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-25T06:06:35.461 DEBUG:teuthology.orchestra.run.smithi088:> sudo service rsyslog restart 2023-01-25T06:06:35.464 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2023-01-25T06:06:35.520 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-01-25T06:06:35.587 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-01-25T06:06:35.994 INFO:teuthology.run_tasks:Running task internal.timer... 2023-01-25T06:06:36.003 INFO:teuthology.task.internal:Starting timer... 2023-01-25T06:06:36.003 INFO:teuthology.run_tasks:Running task pcp... 2023-01-25T06:06:36.016 INFO:teuthology.run_tasks:Running task selinux... 2023-01-25T06:06:36.024 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-01-25T06:06:36.025 DEBUG:teuthology.orchestra.run.smithi088:> sudo service auditd rotate 2023-01-25T06:06:36.087 INFO:teuthology.orchestra.run.smithi088.stdout:Rotating logs: 2023-01-25T06:06:36.089 DEBUG:teuthology.orchestra.run.smithi089:> sudo service auditd rotate 2023-01-25T06:06:36.151 INFO:teuthology.orchestra.run.smithi089.stdout:Rotating logs: 2023-01-25T06:06:36.153 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-01-25T06:06:36.153 DEBUG:teuthology.orchestra.run.smithi088:> /usr/sbin/getenforce 2023-01-25T06:06:36.181 INFO:teuthology.orchestra.run.smithi088.stdout:Permissive 2023-01-25T06:06:36.181 DEBUG:teuthology.orchestra.run.smithi089:> /usr/sbin/getenforce 2023-01-25T06:06:36.201 INFO:teuthology.orchestra.run.smithi089.stdout:Permissive 2023-01-25T06:06:36.201 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi088.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi089.front.sepia.ceph.com': 'permissive'} 2023-01-25T06:06:36.202 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2023-01-25T06:06:36.248 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T06:06:36.251 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2023-01-25T06:06:36.277 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T06:06:36.278 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-01-25T06:06:36.278 DEBUG:teuthology.orchestra.run.smithi088:> sudo /usr/sbin/setenforce permissive 2023-01-25T06:06:36.318 DEBUG:teuthology.orchestra.run.smithi089:> sudo /usr/sbin/setenforce permissive 2023-01-25T06:06:36.346 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-01-25T06:06:36.355 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-01-25T06:06:36.361 INFO:teuthology.repo_utils:Fetching main from origin 2023-01-25T06:06:36.479 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-01-25T06:06:36.497 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-01-25T06:06:36.498 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi088.front.sepia.ceph.com,smithi089.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-01-25T06:13:18.142 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi088.front.sepia.ceph.com'), Remote(name='ubuntu@smithi089.front.sepia.ceph.com')] 2023-01-25T06:13:18.144 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-01-25T06:13:18.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T06:13:18.213 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-01-25T06:13:18.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-01-25T06:13:18.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T06:13:18.307 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-01-25T06:13:18.374 INFO:teuthology.run_tasks:Running task clock... 2023-01-25T06:13:18.385 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-01-25T06:13:18.385 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-25T06:13:18.386 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-25T06:13:18.389 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-25T06:13:18.389 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-25T06:13:18.419 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-01-25T06:13:18.433 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-01-25T06:13:18.447 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-01-25T06:13:18.461 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-01-25T06:13:18.516 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: ntpd: command not found 2023-01-25T06:13:18.527 INFO:teuthology.orchestra.run.smithi088.stdout:506 Cannot talk to daemon 2023-01-25T06:13:18.542 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-01-25T06:13:18.545 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: ntpd: command not found 2023-01-25T06:13:18.556 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-01-25T06:13:18.557 INFO:teuthology.orchestra.run.smithi089.stdout:506 Cannot talk to daemon 2023-01-25T06:13:18.570 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-01-25T06:13:18.584 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-01-25T06:13:18.625 INFO:teuthology.orchestra.run.smithi088.stderr:bash: ntpq: command not found 2023-01-25T06:13:18.628 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-01-25T06:13:18.629 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2023-01-25T06:13:18.629 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T06:13:18.629 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T06:13:18.629 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T06:13:18.629 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T06:13:18.654 INFO:teuthology.orchestra.run.smithi089.stderr:bash: ntpq: command not found 2023-01-25T06:13:18.658 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-01-25T06:13:18.658 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2023-01-25T06:13:18.658 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T06:13:18.658 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T06:13:18.658 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T06:13:18.659 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T06:13:18.660 INFO:teuthology.run_tasks:Running task install... 2023-01-25T06:13:18.676 DEBUG:teuthology.task.install:project ceph 2023-01-25T06:13:18.677 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a'}} 2023-01-25T06:13:18.677 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a'} 2023-01-25T06:13:18.677 INFO:teuthology.task.install:Using flavor: default 2023-01-25T06:13:18.684 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-01-25T06:13:18.685 INFO:teuthology.task.install:extra packages: [] 2023-01-25T06:13:18.685 DEBUG:teuthology.orchestra.run.smithi088:> sudo lsb_release -is 2023-01-25T06:13:18.727 INFO:teuthology.orchestra.run.smithi088.stdout:RedHatEnterprise 2023-01-25T06:13:18.729 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2023-01-25T06:13:18.729 DEBUG:teuthology.orchestra.run.smithi089:> sudo lsb_release -is 2023-01-25T06:13:18.730 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a', 'tag': None, 'wait_for_package': False} 2023-01-25T06:13:18.730 DEBUG:teuthology.orchestra.run.smithi088:> sudo lsb_release -is 2023-01-25T06:13:18.772 INFO:teuthology.orchestra.run.smithi089.stdout:RedHatEnterprise 2023-01-25T06:13:18.773 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2023-01-25T06:13:18.773 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a', 'tag': None, 'wait_for_package': False} 2023-01-25T06:13:18.774 DEBUG:teuthology.orchestra.run.smithi089:> sudo lsb_release -is 2023-01-25T06:13:18.809 INFO:teuthology.orchestra.run.smithi088.stdout:RedHatEnterprise 2023-01-25T06:13:18.810 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2023-01-25T06:13:18.810 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=61996d73ab738798e4ee0055c86457f5c459da4a 2023-01-25T06:13:18.853 INFO:teuthology.orchestra.run.smithi089.stdout:RedHatEnterprise 2023-01-25T06:13:18.855 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2023-01-25T06:13:18.855 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=61996d73ab738798e4ee0055c86457f5c459da4a 2023-01-25T06:13:18.965 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/ 2023-01-25T06:13:18.965 INFO:teuthology.task.install.rpm:Package version is 18.0.0-1963.g61996d73 2023-01-25T06:13:19.010 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/ 2023-01-25T06:13:19.010 INFO:teuthology.task.install.rpm:Package version is 18.0.0-1963.g61996d73 2023-01-25T06:13:19.188 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-01-25T06:13:19.189 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-01-25T06:13:19.189 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-01-25T06:13:19.217 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-01-25T06:13:19.217 DEBUG:teuthology.orchestra.run.smithi088:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/61996d73ab738798e4ee0055c86457f5c459da4a/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-01-25T06:13:19.221 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-01-25T06:13:19.222 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-01-25T06:13:19.222 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-01-25T06:13:19.249 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-01-25T06:13:19.249 DEBUG:teuthology.orchestra.run.smithi089:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/61996d73ab738798e4ee0055c86457f5c459da4a/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-01-25T06:13:19.286 DEBUG:teuthology.orchestra.run.smithi088:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-01-25T06:13:19.317 DEBUG:teuthology.orchestra.run.smithi089:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-01-25T06:13:19.363 DEBUG:teuthology.orchestra.run.smithi088:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-01-25T06:13:19.394 DEBUG:teuthology.orchestra.run.smithi089:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-01-25T06:13:19.428 INFO:teuthology.orchestra.run.smithi088.stdout:check_obsoletes = 1 2023-01-25T06:13:19.430 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum clean all 2023-01-25T06:13:19.460 INFO:teuthology.orchestra.run.smithi089.stdout:check_obsoletes = 1 2023-01-25T06:13:19.461 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum clean all 2023-01-25T06:13:19.799 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:13:19.832 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:13:20.067 INFO:teuthology.orchestra.run.smithi088.stdout:44 files removed 2023-01-25T06:13:20.114 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-radosgw 2023-01-25T06:13:20.117 INFO:teuthology.orchestra.run.smithi089.stdout:44 files removed 2023-01-25T06:13:20.164 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-radosgw 2023-01-25T06:13:20.442 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:13:20.493 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:13:21.071 INFO:teuthology.orchestra.run.smithi088.stdout:ceph packages for x86_64 286 kB/s | 80 kB 00:00 2023-01-25T06:13:21.091 INFO:teuthology.orchestra.run.smithi089.stdout:ceph packages for x86_64 303 kB/s | 80 kB 00:00 2023-01-25T06:13:21.350 INFO:teuthology.orchestra.run.smithi089.stdout:ceph noarch packages 41 kB/s | 9.4 kB 00:00 2023-01-25T06:13:21.355 INFO:teuthology.orchestra.run.smithi088.stdout:ceph noarch packages 37 kB/s | 9.4 kB 00:00 2023-01-25T06:13:21.617 INFO:teuthology.orchestra.run.smithi089.stdout:ceph source packages 6.0 kB/s | 1.5 kB 00:00 2023-01-25T06:13:21.623 INFO:teuthology.orchestra.run.smithi088.stdout:ceph source packages 6.0 kB/s | 1.5 kB 00:00 2023-01-25T06:13:21.748 INFO:teuthology.orchestra.run.smithi088.stdout:Copr repo for python3-asyncssh owned by ceph 33 kB/s | 3.5 kB 00:00 2023-01-25T06:13:21.768 INFO:teuthology.orchestra.run.smithi089.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-01-25T06:13:22.948 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 11 MB/s | 13 MB 00:01 2023-01-25T06:13:22.994 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 11 MB/s | 13 MB 00:01 2023-01-25T06:13:25.874 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 469 kB/s | 24 kB 00:00 2023-01-25T06:13:26.002 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 397 kB/s | 24 kB 00:00 2023-01-25T06:13:26.726 INFO:teuthology.orchestra.run.smithi088.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 60 MB/s | 47 MB 00:00 2023-01-25T06:13:26.914 INFO:teuthology.orchestra.run.smithi089.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 62 MB/s | 53 MB 00:00 2023-01-25T06:13:34.651 INFO:teuthology.orchestra.run.smithi088.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 65 MB/s | 53 MB 00:00 2023-01-25T06:13:35.188 INFO:teuthology.orchestra.run.smithi089.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 46 MB/s | 47 MB 00:01 2023-01-25T06:13:45.699 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T06:13:45.702 INFO:teuthology.orchestra.run.smithi088.stdout:==================================================================================================== 2023-01-25T06:13:45.702 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-01-25T06:13:45.702 INFO:teuthology.orchestra.run.smithi088.stdout:==================================================================================================== 2023-01-25T06:13:45.702 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T06:13:45.702 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw x86_64 2:18.0.0-1963.g61996d73.el8 ceph 13 M 2023-01-25T06:13:45.703 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrading: 2023-01-25T06:13:45.703 INFO:teuthology.orchestra.run.smithi088.stdout: librados2 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.6 M 2023-01-25T06:13:45.703 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.6 M 2023-01-25T06:13:45.703 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-01-25T06:13:45.703 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base x86_64 2:18.0.0-1963.g61996d73.el8 ceph 5.2 M 2023-01-25T06:13:45.704 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common x86_64 2:18.0.0-1963.g61996d73.el8 ceph 24 M 2023-01-25T06:13:45.705 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux x86_64 2:18.0.0-1963.g61996d73.el8 ceph 24 k 2023-01-25T06:13:45.705 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-01-25T06:13:45.705 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 767 k 2023-01-25T06:13:45.705 INFO:teuthology.orchestra.run.smithi088.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-01-25T06:13:45.706 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-01-25T06:13:45.706 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 474 k 2023-01-25T06:13:45.706 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-01-25T06:13:45.706 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 6.5 M 2023-01-25T06:13:45.707 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-01-25T06:13:45.707 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-01-25T06:13:45.707 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse x86_64 2:18.0.0-1963.g61996d73.el8 ceph 45 k 2023-01-25T06:13:45.707 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common x86_64 2:18.0.0-1963.g61996d73.el8 ceph 115 k 2023-01-25T06:13:45.707 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs x86_64 2:18.0.0-1963.g61996d73.el8 ceph 190 k 2023-01-25T06:13:45.708 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-01-25T06:13:45.708 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados x86_64 2:18.0.0-1963.g61996d73.el8 ceph 371 k 2023-01-25T06:13:45.708 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd x86_64 2:18.0.0-1963.g61996d73.el8 ceph 365 k 2023-01-25T06:13:45.708 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw x86_64 2:18.0.0-1963.g61996d73.el8 ceph 107 k 2023-01-25T06:13:45.708 INFO:teuthology.orchestra.run.smithi088.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-01-25T06:13:45.709 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:13:45.709 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T06:13:45.709 INFO:teuthology.orchestra.run.smithi088.stdout:==================================================================================================== 2023-01-25T06:13:45.709 INFO:teuthology.orchestra.run.smithi088.stdout:Install 21 Packages 2023-01-25T06:13:45.709 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrade 2 Packages 2023-01-25T06:13:45.710 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:13:45.710 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 62 M 2023-01-25T06:13:45.711 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T06:13:46.083 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T06:13:46.086 INFO:teuthology.orchestra.run.smithi089.stdout:==================================================================================================== 2023-01-25T06:13:46.086 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-01-25T06:13:46.086 INFO:teuthology.orchestra.run.smithi089.stdout:==================================================================================================== 2023-01-25T06:13:46.086 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T06:13:46.087 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw x86_64 2:18.0.0-1963.g61996d73.el8 ceph 13 M 2023-01-25T06:13:46.087 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrading: 2023-01-25T06:13:46.087 INFO:teuthology.orchestra.run.smithi089.stdout: librados2 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.6 M 2023-01-25T06:13:46.087 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.6 M 2023-01-25T06:13:46.087 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-01-25T06:13:46.088 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base x86_64 2:18.0.0-1963.g61996d73.el8 ceph 5.2 M 2023-01-25T06:13:46.088 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common x86_64 2:18.0.0-1963.g61996d73.el8 ceph 24 M 2023-01-25T06:13:46.088 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux x86_64 2:18.0.0-1963.g61996d73.el8 ceph 24 k 2023-01-25T06:13:46.088 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-01-25T06:13:46.088 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 767 k 2023-01-25T06:13:46.089 INFO:teuthology.orchestra.run.smithi089.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-01-25T06:13:46.089 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-01-25T06:13:46.089 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 474 k 2023-01-25T06:13:46.089 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-01-25T06:13:46.089 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 6.5 M 2023-01-25T06:13:46.090 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-01-25T06:13:46.090 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-01-25T06:13:46.090 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse x86_64 2:18.0.0-1963.g61996d73.el8 ceph 45 k 2023-01-25T06:13:46.090 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common x86_64 2:18.0.0-1963.g61996d73.el8 ceph 115 k 2023-01-25T06:13:46.090 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs x86_64 2:18.0.0-1963.g61996d73.el8 ceph 190 k 2023-01-25T06:13:46.091 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-01-25T06:13:46.091 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados x86_64 2:18.0.0-1963.g61996d73.el8 ceph 371 k 2023-01-25T06:13:46.091 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd x86_64 2:18.0.0-1963.g61996d73.el8 ceph 365 k 2023-01-25T06:13:46.091 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw x86_64 2:18.0.0-1963.g61996d73.el8 ceph 107 k 2023-01-25T06:13:46.091 INFO:teuthology.orchestra.run.smithi089.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-01-25T06:13:46.091 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:13:46.092 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T06:13:46.092 INFO:teuthology.orchestra.run.smithi089.stdout:==================================================================================================== 2023-01-25T06:13:46.092 INFO:teuthology.orchestra.run.smithi089.stdout:Install 21 Packages 2023-01-25T06:13:46.092 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrade 2 Packages 2023-01-25T06:13:46.092 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:13:46.093 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 62 M 2023-01-25T06:13:46.093 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T06:13:46.433 INFO:teuthology.orchestra.run.smithi088.stdout:(1/23): ceph-base-18.0.0-1963.g61996d73.el8.x86 7.1 MB/s | 5.2 MB 00:00 2023-01-25T06:13:46.509 INFO:teuthology.orchestra.run.smithi088.stdout:(2/23): ceph-selinux-18.0.0-1963.g61996d73.el8. 325 kB/s | 24 kB 00:00 2023-01-25T06:13:47.250 INFO:teuthology.orchestra.run.smithi088.stdout:(3/23): libcephfs2-18.0.0-1963.g61996d73.el8.x8 1.0 MB/s | 767 kB 00:00 2023-01-25T06:13:47.351 INFO:teuthology.orchestra.run.smithi088.stdout:(4/23): libradosstriper1-18.0.0-1963.g61996d73. 4.6 MB/s | 474 kB 00:00 2023-01-25T06:13:47.917 INFO:teuthology.orchestra.run.smithi088.stdout:(5/23): ceph-common-18.0.0-1963.g61996d73.el8.x 11 MB/s | 24 MB 00:02 2023-01-25T06:13:48.059 INFO:teuthology.orchestra.run.smithi088.stdout:(6/23): ceph-radosgw-18.0.0-1963.g61996d73.el8. 5.5 MB/s | 13 MB 00:02 2023-01-25T06:13:48.076 INFO:teuthology.orchestra.run.smithi088.stdout:(7/23): python3-ceph-argparse-18.0.0-1963.g6199 281 kB/s | 45 kB 00:00 2023-01-25T06:13:48.110 INFO:teuthology.orchestra.run.smithi088.stdout:(8/23): python3-ceph-common-18.0.0-1963.g61996d 2.2 MB/s | 115 kB 00:00 2023-01-25T06:13:48.127 INFO:teuthology.orchestra.run.smithi088.stdout:(9/23): python3-cephfs-18.0.0-1963.g61996d73.el 3.7 MB/s | 190 kB 00:00 2023-01-25T06:13:48.219 INFO:teuthology.orchestra.run.smithi088.stdout:(10/23): librgw2-18.0.0-1963.g61996d73.el8.x86_ 7.5 MB/s | 6.5 MB 00:00 2023-01-25T06:13:48.244 INFO:teuthology.orchestra.run.smithi088.stdout:(11/23): python3-rbd-18.0.0-1963.g61996d73.el8. 3.0 MB/s | 365 kB 00:00 2023-01-25T06:13:48.269 INFO:teuthology.orchestra.run.smithi088.stdout:(12/23): python3-rados-18.0.0-1963.g61996d73.el 2.3 MB/s | 371 kB 00:00 2023-01-25T06:13:48.295 INFO:teuthology.orchestra.run.smithi088.stdout:(13/23): python3-rgw-18.0.0-1963.g61996d73.el8. 1.4 MB/s | 107 kB 00:00 2023-01-25T06:13:48.388 INFO:teuthology.orchestra.run.smithi089.stdout:(1/23): ceph-base-18.0.0-1963.g61996d73.el8.x86 2.3 MB/s | 5.2 MB 00:02 2023-01-25T06:13:48.430 INFO:teuthology.orchestra.run.smithi089.stdout:(2/23): ceph-selinux-18.0.0-1963.g61996d73.el8. 588 kB/s | 24 kB 00:00 2023-01-25T06:13:48.597 INFO:teuthology.orchestra.run.smithi089.stdout:(3/23): libcephfs2-18.0.0-1963.g61996d73.el8.x8 4.5 MB/s | 767 kB 00:00 2023-01-25T06:13:48.714 INFO:teuthology.orchestra.run.smithi089.stdout:(4/23): libradosstriper1-18.0.0-1963.g61996d73. 4.0 MB/s | 474 kB 00:00 2023-01-25T06:13:49.831 INFO:teuthology.orchestra.run.smithi089.stdout:(5/23): librgw2-18.0.0-1963.g61996d73.el8.x86_6 5.8 MB/s | 6.5 MB 00:01 2023-01-25T06:13:49.973 INFO:teuthology.orchestra.run.smithi089.stdout:(6/23): ceph-radosgw-18.0.0-1963.g61996d73.el8. 3.4 MB/s | 13 MB 00:03 2023-01-25T06:13:49.998 INFO:teuthology.orchestra.run.smithi089.stdout:(7/23): python3-ceph-argparse-18.0.0-1963.g6199 267 kB/s | 45 kB 00:00 2023-01-25T06:13:50.023 INFO:teuthology.orchestra.run.smithi089.stdout:(8/23): python3-ceph-common-18.0.0-1963.g61996d 2.3 MB/s | 115 kB 00:00 2023-01-25T06:13:50.074 INFO:teuthology.orchestra.run.smithi089.stdout:(9/23): python3-cephfs-18.0.0-1963.g61996d73.el 2.5 MB/s | 190 kB 00:00 2023-01-25T06:13:50.149 INFO:teuthology.orchestra.run.smithi089.stdout:(10/23): python3-rados-18.0.0-1963.g61996d73.el 2.9 MB/s | 371 kB 00:00 2023-01-25T06:13:50.199 INFO:teuthology.orchestra.run.smithi089.stdout:(11/23): python3-rbd-18.0.0-1963.g61996d73.el8. 2.8 MB/s | 365 kB 00:00 2023-01-25T06:13:50.224 INFO:teuthology.orchestra.run.smithi089.stdout:(12/23): python3-rgw-18.0.0-1963.g61996d73.el8. 1.4 MB/s | 107 kB 00:00 2023-01-25T06:13:51.490 INFO:teuthology.orchestra.run.smithi089.stdout:(13/23): ceph-common-18.0.0-1963.g61996d73.el8. 4.5 MB/s | 24 MB 00:05 2023-01-25T06:13:51.561 INFO:teuthology.orchestra.run.smithi088.stdout:(14/23): liboath-2.6.2-3.el8.x86_64.rpm 18 kB/s | 59 kB 00:03 2023-01-25T06:13:51.566 INFO:teuthology.orchestra.run.smithi089.stdout:(14/23): liboath-2.6.2-3.el8.x86_64.rpm 44 kB/s | 59 kB 00:01 2023-01-25T06:13:51.578 INFO:teuthology.orchestra.run.smithi088.stdout:(15/23): libunwind-1.3.1-3.el8.x86_64.rpm 23 kB/s | 75 kB 00:03 2023-01-25T06:13:51.634 INFO:teuthology.orchestra.run.smithi089.stdout:(15/23): gperftools-libs-2.7-9.el8.x86_64.rpm 213 kB/s | 306 kB 00:01 2023-01-25T06:13:51.637 INFO:teuthology.orchestra.run.smithi088.stdout:(16/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.4 MB/s | 259 kB 00:00 2023-01-25T06:13:51.659 INFO:teuthology.orchestra.run.smithi089.stdout:(16/23): libunwind-1.3.1-3.el8.x86_64.rpm 447 kB/s | 75 kB 00:00 2023-01-25T06:13:51.662 INFO:teuthology.orchestra.run.smithi088.stdout:(17/23): gperftools-libs-2.7-9.el8.x86_64.rpm 90 kB/s | 306 kB 00:03 2023-01-25T06:13:51.687 INFO:teuthology.orchestra.run.smithi088.stdout:(18/23): python3-prettytable-0.7.2-14.el8.noarc 878 kB/s | 44 kB 00:00 2023-01-25T06:13:51.709 INFO:teuthology.orchestra.run.smithi089.stdout:(17/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 623 kB/s | 47 kB 00:00 2023-01-25T06:13:51.729 INFO:teuthology.orchestra.run.smithi088.stdout:(19/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.3 MB/s | 47 kB 00:00 2023-01-25T06:13:51.734 INFO:teuthology.orchestra.run.smithi089.stdout:(18/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.4 MB/s | 259 kB 00:00 2023-01-25T06:13:51.755 INFO:teuthology.orchestra.run.smithi088.stdout:(20/23): librdkafka-0.11.4-3.el8.x86_64.rpm 3.8 MB/s | 354 kB 00:00 2023-01-25T06:13:51.759 INFO:teuthology.orchestra.run.smithi089.stdout:(19/23): python3-prettytable-0.7.2-14.el8.noarc 878 kB/s | 44 kB 00:00 2023-01-25T06:13:51.793 INFO:teuthology.orchestra.run.smithi089.stdout:(20/23): librdkafka-0.11.4-3.el8.x86_64.rpm 5.9 MB/s | 354 kB 00:00 2023-01-25T06:13:51.877 INFO:teuthology.orchestra.run.smithi089.stdout:(21/23): thrift-0.13.0-2.el8.x86_64.rpm 5.6 MB/s | 1.7 MB 00:00 2023-01-25T06:13:51.905 INFO:teuthology.orchestra.run.smithi088.stdout:(21/23): thrift-0.13.0-2.el8.x86_64.rpm 5.3 MB/s | 1.7 MB 00:00 2023-01-25T06:13:52.172 INFO:teuthology.orchestra.run.smithi088.stdout:(22/23): librados2-18.0.0-1963.g61996d73.el8.x8 8.2 MB/s | 3.6 MB 00:00 2023-01-25T06:13:52.230 INFO:teuthology.orchestra.run.smithi088.stdout:(23/23): librbd1-18.0.0-1963.g61996d73.el8.x86_ 7.5 MB/s | 3.6 MB 00:00 2023-01-25T06:13:52.233 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:13:52.233 INFO:teuthology.orchestra.run.smithi088.stdout:Total 9.4 MB/s | 62 MB 00:06 2023-01-25T06:13:52.281 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T06:13:52.327 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T06:13:52.327 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T06:13:52.452 INFO:teuthology.orchestra.run.smithi089.stdout:(22/23): librbd1-18.0.0-1963.g61996d73.el8.x86_ 5.4 MB/s | 3.6 MB 00:00 2023-01-25T06:13:52.586 INFO:teuthology.orchestra.run.smithi089.stdout:(23/23): librados2-18.0.0-1963.g61996d73.el8.x8 4.4 MB/s | 3.6 MB 00:00 2023-01-25T06:13:52.588 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:13:52.588 INFO:teuthology.orchestra.run.smithi089.stdout:Total 9.5 MB/s | 62 MB 00:06 2023-01-25T06:13:52.636 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T06:13:52.667 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T06:13:52.670 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T06:13:52.682 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T06:13:52.682 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T06:13:53.027 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T06:13:53.031 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T06:13:53.870 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T06:13:54.110 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/25 2023-01-25T06:13:54.206 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T06:13:54.315 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-01-25T06:13:54.465 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/25 2023-01-25T06:13:54.663 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-01-25T06:13:54.711 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-01-25T06:13:54.906 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librados2-2:18.0.0-1963.g61996d73.el8.x86_64 3/25 2023-01-25T06:13:55.004 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:18.0.0-1963.g61996d73.el8.x86_64 3/25 2023-01-25T06:13:55.057 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-01-25T06:13:55.280 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librados2-2:18.0.0-1963.g61996d73.el8.x86_64 3/25 2023-01-25T06:13:55.330 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 4/25 2023-01-25T06:13:55.377 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:18.0.0-1963.g61996d73.el8.x86_64 3/25 2023-01-25T06:13:55.570 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 4/25 2023-01-25T06:13:55.587 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/25 2023-01-25T06:13:55.765 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 6/25 2023-01-25T06:13:55.803 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/25 2023-01-25T06:13:55.980 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 6/25 2023-01-25T06:13:56.163 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 6/25 2023-01-25T06:13:56.339 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 7/25 2023-01-25T06:13:56.360 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 6/25 2023-01-25T06:13:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 7/25 2023-01-25T06:13:56.562 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/25 2023-01-25T06:13:56.689 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-01-25T06:13:56.740 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-01-25T06:13:56.746 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 7/25 2023-01-25T06:13:56.845 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 7/25 2023-01-25T06:13:56.908 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-argparse-2:18.0.0-1963.g61996d73.el8. 10/25 2023-01-25T06:13:57.005 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 8/25 2023-01-25T06:13:57.071 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 8/25 2023-01-25T06:13:57.092 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 11/25 2023-01-25T06:13:57.237 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/25 2023-01-25T06:13:57.290 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 12/25 2023-01-25T06:13:57.382 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-argparse-2:18.0.0-1963.g61996d73.el8. 10/25 2023-01-25T06:13:57.448 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_6 13/25 2023-01-25T06:13:57.519 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_6 13/25 2023-01-25T06:13:57.578 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 11/25 2023-01-25T06:13:57.665 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 14/25 2023-01-25T06:13:57.798 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 12/25 2023-01-25T06:13:57.856 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 15/25 2023-01-25T06:13:57.956 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_6 13/25 2023-01-25T06:13:58.020 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_6 13/25 2023-01-25T06:13:58.173 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 14/25 2023-01-25T06:13:58.382 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 15/25 2023-01-25T06:13:58.624 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 16/25 2023-01-25T06:13:58.831 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 17/25 2023-01-25T06:13:58.910 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 17/25 2023-01-25T06:13:59.131 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 18/25 2023-01-25T06:13:59.156 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 16/25 2023-01-25T06:13:59.298 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-common-2:18.0.0-1963.g61996d73.el8.x8 19/25 2023-01-25T06:13:59.346 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 17/25 2023-01-25T06:13:59.409 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 17/25 2023-01-25T06:13:59.654 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 18/25 2023-01-25T06:13:59.846 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-common-2:18.0.0-1963.g61996d73.el8.x8 19/25 2023-01-25T06:14:03.335 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 20/25 2023-01-25T06:14:03.597 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 20/25 2023-01-25T06:14:03.625 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 20/25 2023-01-25T06:14:03.871 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 20/25 2023-01-25T06:14:04.180 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 20/25 2023-01-25T06:14:04.456 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 21/25 2023-01-25T06:14:04.457 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 20/25 2023-01-25T06:14:04.531 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 21/25 2023-01-25T06:14:04.688 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 22/25 2023-01-25T06:14:04.753 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 21/25 2023-01-25T06:14:04.820 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 21/25 2023-01-25T06:14:05.029 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 22/25 2023-01-25T06:14:23.047 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 22/25 2023-01-25T06:14:23.047 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /sys 2023-01-25T06:14:23.047 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /proc 2023-01-25T06:14:23.048 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /dev 2023-01-25T06:14:23.048 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /run 2023-01-25T06:14:23.048 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /mnt 2023-01-25T06:14:23.048 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /var/tmp 2023-01-25T06:14:23.049 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /home 2023-01-25T06:14:23.049 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /tmp 2023-01-25T06:14:23.049 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /dev 2023-01-25T06:14:23.049 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:14:23.255 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 22/25 2023-01-25T06:14:23.255 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /sys 2023-01-25T06:14:23.255 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /proc 2023-01-25T06:14:23.255 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /dev 2023-01-25T06:14:23.256 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /run 2023-01-25T06:14:23.256 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /mnt 2023-01-25T06:14:23.256 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /var/tmp 2023-01-25T06:14:23.256 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /home 2023-01-25T06:14:23.256 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /tmp 2023-01-25T06:14:23.257 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /dev 2023-01-25T06:14:23.257 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:14:24.402 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 23/25 2023-01-25T06:14:24.422 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 23/25 2023-01-25T06:14:24.422 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-25T06:14:24.608 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 23/25 2023-01-25T06:14:24.629 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 23/25 2023-01-25T06:14:24.629 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-25T06:14:24.635 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-25T06:14:24.635 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T06:14:24.845 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-25T06:14:24.845 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T06:14:25.089 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T06:14:25.090 INFO:teuthology.orchestra.run.smithi088.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-01-25T06:14:25.090 INFO:teuthology.orchestra.run.smithi088.stdout:All rules containing unresolvable specifiers will be skipped. 2023-01-25T06:14:25.090 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:14:25.243 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 1/25 2023-01-25T06:14:25.244 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 2/25 2023-01-25T06:14:25.244 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 3/25 2023-01-25T06:14:25.244 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 4/25 2023-01-25T06:14:25.244 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 5/25 2023-01-25T06:14:25.245 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_6 6/25 2023-01-25T06:14:25.245 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 7/25 2023-01-25T06:14:25.245 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-argparse-2:18.0.0-1963.g61996d73.el8. 8/25 2023-01-25T06:14:25.245 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-common-2:18.0.0-1963.g61996d73.el8.x8 9/25 2023-01-25T06:14:25.245 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 10/25 2023-01-25T06:14:25.246 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 11/25 2023-01-25T06:14:25.246 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 12/25 2023-01-25T06:14:25.246 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 13/25 2023-01-25T06:14:25.246 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 14/25 2023-01-25T06:14:25.246 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 15/25 2023-01-25T06:14:25.247 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 16/25 2023-01-25T06:14:25.247 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 17/25 2023-01-25T06:14:25.247 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 18/25 2023-01-25T06:14:25.247 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 19/25 2023-01-25T06:14:25.247 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 20/25 2023-01-25T06:14:25.248 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 21/25 2023-01-25T06:14:25.248 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:18.0.0-1963.g61996d73.el8.x86_64 22/25 2023-01-25T06:14:25.248 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-01-25T06:14:25.248 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 24/25 2023-01-25T06:14:25.292 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T06:14:25.293 INFO:teuthology.orchestra.run.smithi089.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-01-25T06:14:25.293 INFO:teuthology.orchestra.run.smithi089.stdout:All rules containing unresolvable specifiers will be skipped. 2023-01-25T06:14:25.293 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:14:25.446 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 1/25 2023-01-25T06:14:25.446 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 2/25 2023-01-25T06:14:25.447 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 3/25 2023-01-25T06:14:25.447 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 4/25 2023-01-25T06:14:25.447 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 5/25 2023-01-25T06:14:25.447 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_6 6/25 2023-01-25T06:14:25.447 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 7/25 2023-01-25T06:14:25.448 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-argparse-2:18.0.0-1963.g61996d73.el8. 8/25 2023-01-25T06:14:25.448 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-common-2:18.0.0-1963.g61996d73.el8.x8 9/25 2023-01-25T06:14:25.448 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 10/25 2023-01-25T06:14:25.448 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 11/25 2023-01-25T06:14:25.448 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 12/25 2023-01-25T06:14:25.449 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 13/25 2023-01-25T06:14:25.449 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 14/25 2023-01-25T06:14:25.449 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 15/25 2023-01-25T06:14:25.449 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 16/25 2023-01-25T06:14:25.450 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 17/25 2023-01-25T06:14:25.450 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 18/25 2023-01-25T06:14:25.450 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 19/25 2023-01-25T06:14:25.450 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 20/25 2023-01-25T06:14:25.450 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 21/25 2023-01-25T06:14:25.450 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:18.0.0-1963.g61996d73.el8.x86_64 22/25 2023-01-25T06:14:25.451 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-01-25T06:14:25.451 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 24/25 2023-01-25T06:14:26.647 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T06:14:26.647 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:52 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:14:26.836 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T06:14:26.836 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:52 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:14:29.150 INFO:teuthology.orchestra.run.smithi088.stdout:Installed products updated. 2023-01-25T06:14:29.342 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:14:29.342 INFO:teuthology.orchestra.run.smithi088.stdout:Upgraded: 2023-01-25T06:14:29.343 INFO:teuthology.orchestra.run.smithi088.stdout: librados2-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.343 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.343 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T06:14:29.343 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.344 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.344 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.344 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.344 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-01-25T06:14:29.345 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.345 INFO:teuthology.orchestra.run.smithi088.stdout: liboath-2.6.2-3.el8.x86_64 2023-01-25T06:14:29.345 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-01-25T06:14:29.345 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.345 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-01-25T06:14:29.346 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.346 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind-1.3.1-3.el8.x86_64 2023-01-25T06:14:29.346 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-01-25T06:14:29.346 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.347 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.347 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.347 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-01-25T06:14:29.347 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.347 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.348 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.348 INFO:teuthology.orchestra.run.smithi088.stdout: thrift-0.13.0-2.el8.x86_64 2023-01-25T06:14:29.348 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:14:29.348 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T06:14:29.361 INFO:teuthology.orchestra.run.smithi089.stdout:Installed products updated. 2023-01-25T06:14:29.552 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-test 2023-01-25T06:14:29.565 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:14:29.566 INFO:teuthology.orchestra.run.smithi089.stdout:Upgraded: 2023-01-25T06:14:29.566 INFO:teuthology.orchestra.run.smithi089.stdout: librados2-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.566 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.566 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T06:14:29.566 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.567 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.567 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.567 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.567 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-01-25T06:14:29.567 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.568 INFO:teuthology.orchestra.run.smithi089.stdout: liboath-2.6.2-3.el8.x86_64 2023-01-25T06:14:29.568 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-01-25T06:14:29.568 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.568 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-01-25T06:14:29.569 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.569 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind-1.3.1-3.el8.x86_64 2023-01-25T06:14:29.569 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-01-25T06:14:29.569 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.569 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.569 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.570 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-01-25T06:14:29.570 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.570 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.570 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:29.570 INFO:teuthology.orchestra.run.smithi089.stdout: thrift-0.13.0-2.el8.x86_64 2023-01-25T06:14:29.571 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:14:29.571 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T06:14:29.743 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-test 2023-01-25T06:14:29.896 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:14:30.087 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:14:30.674 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:56 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:14:30.876 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:56 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:14:32.041 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T06:14:32.042 INFO:teuthology.orchestra.run.smithi088.stdout:============================================================================================ 2023-01-25T06:14:32.043 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-01-25T06:14:32.043 INFO:teuthology.orchestra.run.smithi088.stdout:============================================================================================ 2023-01-25T06:14:32.043 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T06:14:32.044 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test x86_64 2:18.0.0-1963.g61996d73.el8 ceph 47 M 2023-01-25T06:14:32.044 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-01-25T06:14:32.045 INFO:teuthology.orchestra.run.smithi088.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-01-25T06:14:32.045 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite x86_64 2:18.0.0-1963.g61996d73.el8 ceph 137 k 2023-01-25T06:14:32.045 INFO:teuthology.orchestra.run.smithi088.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-01-25T06:14:32.045 INFO:teuthology.orchestra.run.smithi088.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-01-25T06:14:32.046 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-01-25T06:14:32.046 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:14:32.046 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T06:14:32.046 INFO:teuthology.orchestra.run.smithi088.stdout:============================================================================================ 2023-01-25T06:14:32.046 INFO:teuthology.orchestra.run.smithi088.stdout:Install 6 Packages 2023-01-25T06:14:32.047 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:14:32.047 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 48 M 2023-01-25T06:14:32.047 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 218 M 2023-01-25T06:14:32.048 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T06:14:32.082 INFO:teuthology.orchestra.run.smithi088.stdout:(1/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.9 MB/s | 70 kB 00:00 2023-01-25T06:14:32.149 INFO:teuthology.orchestra.run.smithi088.stdout:(2/6): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-01-25T06:14:32.191 INFO:teuthology.orchestra.run.smithi088.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-01-25T06:14:32.232 INFO:teuthology.orchestra.run.smithi088.stdout:(4/6): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2023-01-25T06:14:32.283 INFO:teuthology.orchestra.run.smithi088.stdout:(5/6): libcephsqlite-18.0.0-1963.g61996d73.el8. 577 kB/s | 137 kB 00:00 2023-01-25T06:14:32.326 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T06:14:32.327 INFO:teuthology.orchestra.run.smithi089.stdout:============================================================================================ 2023-01-25T06:14:32.327 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-01-25T06:14:32.328 INFO:teuthology.orchestra.run.smithi089.stdout:============================================================================================ 2023-01-25T06:14:32.328 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T06:14:32.328 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test x86_64 2:18.0.0-1963.g61996d73.el8 ceph 47 M 2023-01-25T06:14:32.328 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-01-25T06:14:32.328 INFO:teuthology.orchestra.run.smithi089.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-01-25T06:14:32.329 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite x86_64 2:18.0.0-1963.g61996d73.el8 ceph 137 k 2023-01-25T06:14:32.329 INFO:teuthology.orchestra.run.smithi089.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-01-25T06:14:32.329 INFO:teuthology.orchestra.run.smithi089.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-01-25T06:14:32.329 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-01-25T06:14:32.329 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:14:32.330 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T06:14:32.330 INFO:teuthology.orchestra.run.smithi089.stdout:============================================================================================ 2023-01-25T06:14:32.330 INFO:teuthology.orchestra.run.smithi089.stdout:Install 6 Packages 2023-01-25T06:14:32.330 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:14:32.331 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 48 M 2023-01-25T06:14:32.331 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 218 M 2023-01-25T06:14:32.331 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T06:14:32.369 INFO:teuthology.orchestra.run.smithi089.stdout:(1/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.7 MB/s | 70 kB 00:00 2023-01-25T06:14:32.436 INFO:teuthology.orchestra.run.smithi089.stdout:(2/6): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-01-25T06:14:32.478 INFO:teuthology.orchestra.run.smithi089.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-01-25T06:14:32.520 INFO:teuthology.orchestra.run.smithi089.stdout:(4/6): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2023-01-25T06:14:32.570 INFO:teuthology.orchestra.run.smithi089.stdout:(5/6): libcephsqlite-18.0.0-1963.g61996d73.el8. 570 kB/s | 137 kB 00:00 2023-01-25T06:14:35.407 INFO:teuthology.orchestra.run.smithi088.stdout:(6/6): ceph-test-18.0.0-1963.g61996d73.el8.x86_ 14 MB/s | 47 MB 00:03 2023-01-25T06:14:35.409 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:14:35.410 INFO:teuthology.orchestra.run.smithi088.stdout:Total 14 MB/s | 48 MB 00:03 2023-01-25T06:14:35.446 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T06:14:35.467 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T06:14:35.468 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T06:14:35.726 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T06:14:35.730 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T06:14:36.158 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T06:14:36.289 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 1/6 2023-01-25T06:14:36.360 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 1/6 2023-01-25T06:14:36.370 INFO:teuthology.orchestra.run.smithi089.stdout:(6/6): ceph-test-18.0.0-1963.g61996d73.el8.x86_ 12 MB/s | 47 MB 00:04 2023-01-25T06:14:36.372 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:14:36.373 INFO:teuthology.orchestra.run.smithi089.stdout:Total 12 MB/s | 48 MB 00:04 2023-01-25T06:14:36.411 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T06:14:36.431 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T06:14:36.432 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T06:14:36.594 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : jq-1.6-3.el8.x86_64 2/6 2023-01-25T06:14:36.688 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T06:14:36.692 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T06:14:36.773 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 3/6 2023-01-25T06:14:36.934 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 4/6 2023-01-25T06:14:37.097 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 5/6 2023-01-25T06:14:37.124 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T06:14:37.273 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 1/6 2023-01-25T06:14:37.356 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 1/6 2023-01-25T06:14:37.583 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : jq-1.6-3.el8.x86_64 2/6 2023-01-25T06:14:37.774 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 3/6 2023-01-25T06:14:37.936 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 4/6 2023-01-25T06:14:38.140 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 5/6 2023-01-25T06:14:41.758 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 5/6 2023-01-25T06:14:42.043 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 6/6 2023-01-25T06:14:42.251 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 6/6 2023-01-25T06:14:42.252 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 1/6 2023-01-25T06:14:42.252 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 2/6 2023-01-25T06:14:42.252 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 3/6 2023-01-25T06:14:42.252 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/6 2023-01-25T06:14:42.253 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 5/6 2023-01-25T06:14:42.780 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 5/6 2023-01-25T06:14:43.070 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 6/6 2023-01-25T06:14:43.300 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 6/6 2023-01-25T06:14:43.300 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 1/6 2023-01-25T06:14:43.301 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 2/6 2023-01-25T06:14:43.301 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 3/6 2023-01-25T06:14:43.301 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/6 2023-01-25T06:14:43.301 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 5/6 2023-01-25T06:14:43.329 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : jq-1.6-3.el8.x86_64 6/6 2023-01-25T06:14:43.329 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:09 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:14:44.371 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : jq-1.6-3.el8.x86_64 6/6 2023-01-25T06:14:44.372 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:10 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:14:45.668 INFO:teuthology.orchestra.run.smithi088.stdout:Installed products updated. 2023-01-25T06:14:45.849 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:14:45.849 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T06:14:45.849 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:45.850 INFO:teuthology.orchestra.run.smithi088.stdout: jq-1.6-3.el8.x86_64 2023-01-25T06:14:45.850 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:45.850 INFO:teuthology.orchestra.run.smithi088.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-01-25T06:14:45.850 INFO:teuthology.orchestra.run.smithi088.stdout: socat-1.7.4.1-1.el8.x86_64 2023-01-25T06:14:45.850 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-01-25T06:14:45.851 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:14:45.851 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T06:14:45.983 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph 2023-01-25T06:14:46.314 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:14:46.774 INFO:teuthology.orchestra.run.smithi089.stdout:Installed products updated. 2023-01-25T06:14:46.952 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:14:46.953 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T06:14:46.953 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:46.953 INFO:teuthology.orchestra.run.smithi089.stdout: jq-1.6-3.el8.x86_64 2023-01-25T06:14:46.953 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:14:46.954 INFO:teuthology.orchestra.run.smithi089.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-01-25T06:14:46.954 INFO:teuthology.orchestra.run.smithi089.stdout: socat-1.7.4.1-1.el8.x86_64 2023-01-25T06:14:46.954 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-01-25T06:14:46.954 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:14:46.954 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T06:14:47.079 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph 2023-01-25T06:14:47.126 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:13 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:14:47.412 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:14:48.231 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:14 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:14:48.527 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T06:14:48.531 INFO:teuthology.orchestra.run.smithi088.stdout:======================================================================================================= 2023-01-25T06:14:48.531 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-01-25T06:14:48.531 INFO:teuthology.orchestra.run.smithi088.stdout:======================================================================================================= 2023-01-25T06:14:48.531 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T06:14:48.532 INFO:teuthology.orchestra.run.smithi088.stdout: ceph x86_64 2:18.0.0-1963.g61996d73.el8 ceph 6.4 k 2023-01-25T06:14:48.532 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-01-25T06:14:48.532 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds x86_64 2:18.0.0-1963.g61996d73.el8 ceph 2.3 M 2023-01-25T06:14:48.532 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr x86_64 2:18.0.0-1963.g61996d73.el8 ceph 1.5 M 2023-01-25T06:14:48.532 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 236 k 2023-01-25T06:14:48.533 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.9 M 2023-01-25T06:14:48.533 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd x86_64 2:18.0.0-1963.g61996d73.el8 ceph 17 M 2023-01-25T06:14:48.533 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-01-25T06:14:48.533 INFO:teuthology.orchestra.run.smithi088.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-01-25T06:14:48.533 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-01-25T06:14:48.534 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-01-25T06:14:48.534 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-01-25T06:14:48.534 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-01-25T06:14:48.534 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-01-25T06:14:48.534 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-01-25T06:14:48.535 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-01-25T06:14:48.535 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-01-25T06:14:48.535 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-01-25T06:14:48.536 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-01-25T06:14:48.536 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-01-25T06:14:48.536 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-01-25T06:14:48.536 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-01-25T06:14:48.536 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-01-25T06:14:48.537 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-01-25T06:14:48.537 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-01-25T06:14:48.537 INFO:teuthology.orchestra.run.smithi088.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-01-25T06:14:48.537 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-01-25T06:14:48.537 INFO:teuthology.orchestra.run.smithi088.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-01-25T06:14:48.538 INFO:teuthology.orchestra.run.smithi088.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-01-25T06:14:48.538 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-01-25T06:14:48.538 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-01-25T06:14:48.538 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-01-25T06:14:48.538 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-01-25T06:14:48.539 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:14:48.539 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T06:14:48.539 INFO:teuthology.orchestra.run.smithi088.stdout:======================================================================================================= 2023-01-25T06:14:48.539 INFO:teuthology.orchestra.run.smithi088.stdout:Install 32 Packages 2023-01-25T06:14:48.539 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:14:48.540 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 28 M 2023-01-25T06:14:48.540 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 110 M 2023-01-25T06:14:48.541 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T06:14:48.841 INFO:teuthology.orchestra.run.smithi088.stdout:(1/32): ceph-18.0.0-1963.g61996d73.el8.x86_64.r 21 kB/s | 6.4 kB 00:00 2023-01-25T06:14:49.633 INFO:teuthology.orchestra.run.smithi088.stdout:(2/32): ceph-mds-18.0.0-1963.g61996d73.el8.x86_ 2.1 MB/s | 2.3 MB 00:01 2023-01-25T06:14:49.688 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T06:14:49.691 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================================= 2023-01-25T06:14:49.691 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-01-25T06:14:49.692 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================================= 2023-01-25T06:14:49.692 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T06:14:49.692 INFO:teuthology.orchestra.run.smithi089.stdout: ceph x86_64 2:18.0.0-1963.g61996d73.el8 ceph 6.4 k 2023-01-25T06:14:49.693 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-01-25T06:14:49.693 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds x86_64 2:18.0.0-1963.g61996d73.el8 ceph 2.3 M 2023-01-25T06:14:49.693 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr x86_64 2:18.0.0-1963.g61996d73.el8 ceph 1.5 M 2023-01-25T06:14:49.693 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 236 k 2023-01-25T06:14:49.694 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.9 M 2023-01-25T06:14:49.694 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd x86_64 2:18.0.0-1963.g61996d73.el8 ceph 17 M 2023-01-25T06:14:49.694 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-01-25T06:14:49.694 INFO:teuthology.orchestra.run.smithi089.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-01-25T06:14:49.694 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-01-25T06:14:49.695 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-01-25T06:14:49.695 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-01-25T06:14:49.695 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-01-25T06:14:49.695 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-01-25T06:14:49.695 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-01-25T06:14:49.696 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-01-25T06:14:49.696 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-01-25T06:14:49.696 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-01-25T06:14:49.696 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-01-25T06:14:49.696 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-01-25T06:14:49.697 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-01-25T06:14:49.697 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-01-25T06:14:49.697 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-01-25T06:14:49.697 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-01-25T06:14:49.697 INFO:teuthology.orchestra.run.smithi089.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-01-25T06:14:49.698 INFO:teuthology.orchestra.run.smithi089.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-01-25T06:14:49.698 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-01-25T06:14:49.698 INFO:teuthology.orchestra.run.smithi089.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-01-25T06:14:49.698 INFO:teuthology.orchestra.run.smithi089.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-01-25T06:14:49.698 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-01-25T06:14:49.699 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-01-25T06:14:49.699 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-01-25T06:14:49.699 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-01-25T06:14:49.699 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:14:49.699 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T06:14:49.700 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================================= 2023-01-25T06:14:49.700 INFO:teuthology.orchestra.run.smithi089.stdout:Install 32 Packages 2023-01-25T06:14:49.700 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:14:49.701 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 28 M 2023-01-25T06:14:49.701 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 110 M 2023-01-25T06:14:49.701 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T06:14:50.056 INFO:teuthology.orchestra.run.smithi089.stdout:(1/32): ceph-18.0.0-1963.g61996d73.el8.x86_64.r 18 kB/s | 6.4 kB 00:00 2023-01-25T06:14:50.566 INFO:teuthology.orchestra.run.smithi088.stdout:(3/32): ceph-mgr-18.0.0-1963.g61996d73.el8.x86_ 772 kB/s | 1.5 MB 00:02 2023-01-25T06:14:50.741 INFO:teuthology.orchestra.run.smithi088.stdout:(4/32): ceph-mgr-modules-core-18.0.0-1963.g6199 1.3 MB/s | 236 kB 00:00 2023-01-25T06:14:50.908 INFO:teuthology.orchestra.run.smithi088.stdout:(5/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm 261 kB/s | 44 kB 00:00 2023-01-25T06:14:51.034 INFO:teuthology.orchestra.run.smithi088.stdout:(6/32): python3-beautifulsoup4-4.6.3-2.el8.1.no 1.4 MB/s | 185 kB 00:00 2023-01-25T06:14:51.093 INFO:teuthology.orchestra.run.smithi088.stdout:(7/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 2.9 MB/s | 173 kB 00:00 2023-01-25T06:14:51.201 INFO:teuthology.orchestra.run.smithi088.stdout:(8/32): python3-cherrypy-18.4.0-1.el8.noarch.rp 3.5 MB/s | 384 kB 00:00 2023-01-25T06:14:51.260 INFO:teuthology.orchestra.run.smithi088.stdout:(9/32): python3-jaraco-6.2-6.el8.noarch.rpm 190 kB/s | 11 kB 00:00 2023-01-25T06:14:51.318 INFO:teuthology.orchestra.run.smithi088.stdout:(10/32): python3-jaraco-functools-2.0-4.el8.noa 301 kB/s | 18 kB 00:00 2023-01-25T06:14:51.393 INFO:teuthology.orchestra.run.smithi088.stdout:(11/32): python3-logutils-0.3.5-11.el8.noarch.r 651 kB/s | 49 kB 00:00 2023-01-25T06:14:51.439 INFO:teuthology.orchestra.run.smithi089.stdout:(2/32): ceph-mgr-18.0.0-1963.g61996d73.el8.x86_ 900 kB/s | 1.5 MB 00:01 2023-01-25T06:14:51.452 INFO:teuthology.orchestra.run.smithi088.stdout:(12/32): python3-more-itertools-7.2.0-3.el8.noa 1.0 MB/s | 59 kB 00:00 2023-01-25T06:14:51.519 INFO:teuthology.orchestra.run.smithi088.stdout:(13/32): python3-pecan-1.3.2-9.el8.noarch.rpm 4.1 MB/s | 283 kB 00:00 2023-01-25T06:14:51.578 INFO:teuthology.orchestra.run.smithi088.stdout:(14/32): python3-portend-2.6-1.el8.noarch.rpm 268 kB/s | 16 kB 00:00 2023-01-25T06:14:51.636 INFO:teuthology.orchestra.run.smithi088.stdout:(15/32): python3-simplegeneric-0.8.1-17.el8.noa 322 kB/s | 19 kB 00:00 2023-01-25T06:14:51.695 INFO:teuthology.orchestra.run.smithi088.stdout:(16/32): python3-singledispatch-3.4.0.3-18.el8. 410 kB/s | 24 kB 00:00 2023-01-25T06:14:51.715 INFO:teuthology.orchestra.run.smithi089.stdout:(3/32): ceph-mds-18.0.0-1963.g61996d73.el8.x86_ 1.1 MB/s | 2.3 MB 00:02 2023-01-25T06:14:51.754 INFO:teuthology.orchestra.run.smithi088.stdout:(17/32): python3-tempora-1.14.1-5.el8.noarch.rp 502 kB/s | 29 kB 00:00 2023-01-25T06:14:51.812 INFO:teuthology.orchestra.run.smithi088.stdout:(18/32): python3-trustme-0.6.0-4.el8.noarch.rpm 473 kB/s | 27 kB 00:00 2023-01-25T06:14:51.871 INFO:teuthology.orchestra.run.smithi088.stdout:(19/32): python3-waitress-1.2.1-2.el8.1.noarch. 4.1 MB/s | 241 kB 00:00 2023-01-25T06:14:51.898 INFO:teuthology.orchestra.run.smithi089.stdout:(4/32): ceph-mgr-modules-core-18.0.0-1963.g6199 1.3 MB/s | 236 kB 00:00 2023-01-25T06:14:51.929 INFO:teuthology.orchestra.run.smithi088.stdout:(20/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 4.2 MB/s | 251 kB 00:00 2023-01-25T06:14:51.988 INFO:teuthology.orchestra.run.smithi088.stdout:(21/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.4 MB/s | 85 kB 00:00 2023-01-25T06:14:52.046 INFO:teuthology.orchestra.run.smithi088.stdout:(22/32): python3-zc-lockfile-2.0-2.el8.noarch.r 396 kB/s | 23 kB 00:00 2023-01-25T06:14:52.057 INFO:teuthology.orchestra.run.smithi089.stdout:(5/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm 276 kB/s | 44 kB 00:00 2023-01-25T06:14:52.105 INFO:teuthology.orchestra.run.smithi088.stdout:(23/32): python3-pytz-2017.2-9.el8.noarch.rpm 927 kB/s | 54 kB 00:00 2023-01-25T06:14:52.164 INFO:teuthology.orchestra.run.smithi088.stdout:(24/32): ceph-mon-18.0.0-1963.g61996d73.el8.x86 1.2 MB/s | 3.9 MB 00:03 2023-01-25T06:14:52.182 INFO:teuthology.orchestra.run.smithi089.stdout:(6/32): python3-beautifulsoup4-4.6.3-2.el8.1.no 1.4 MB/s | 185 kB 00:00 2023-01-25T06:14:52.189 INFO:teuthology.orchestra.run.smithi088.stdout:(25/32): python3-markupsafe-0.23-19.el8.x86_64. 465 kB/s | 39 kB 00:00 2023-01-25T06:14:52.239 INFO:teuthology.orchestra.run.smithi088.stdout:(26/32): python3-mako-1.0.6-13.el8.noarch.rpm 2.0 MB/s | 157 kB 00:00 2023-01-25T06:14:52.240 INFO:teuthology.orchestra.run.smithi089.stdout:(7/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 2.9 MB/s | 173 kB 00:00 2023-01-25T06:14:52.265 INFO:teuthology.orchestra.run.smithi088.stdout:(27/32): python3-werkzeug-0.12.2-4.el8.noarch.r 6.4 MB/s | 457 kB 00:00 2023-01-25T06:14:52.290 INFO:teuthology.orchestra.run.smithi088.stdout:(28/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 2.0 MB/s | 103 kB 00:00 2023-01-25T06:14:52.315 INFO:teuthology.orchestra.run.smithi088.stdout:(29/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.6 MB/s | 238 kB 00:00 2023-01-25T06:14:52.340 INFO:teuthology.orchestra.run.smithi088.stdout:(30/32): python3-pycparser-2.14-14.el8.noarch.r 2.1 MB/s | 109 kB 00:00 2023-01-25T06:14:52.354 INFO:teuthology.orchestra.run.smithi089.stdout:(8/32): python3-cherrypy-18.4.0-1.el8.noarch.rp 3.3 MB/s | 384 kB 00:00 2023-01-25T06:14:52.374 INFO:teuthology.orchestra.run.smithi088.stdout:(31/32): python3-cryptography-3.2.1-5.el8.x86_6 9.4 MB/s | 559 kB 00:00 2023-01-25T06:14:52.417 INFO:teuthology.orchestra.run.smithi089.stdout:(9/32): python3-jaraco-6.2-6.el8.noarch.rpm 179 kB/s | 11 kB 00:00 2023-01-25T06:14:52.475 INFO:teuthology.orchestra.run.smithi089.stdout:(10/32): python3-jaraco-functools-2.0-4.el8.noa 302 kB/s | 18 kB 00:00 2023-01-25T06:14:52.534 INFO:teuthology.orchestra.run.smithi089.stdout:(11/32): python3-logutils-0.3.5-11.el8.noarch.r 836 kB/s | 49 kB 00:00 2023-01-25T06:14:52.593 INFO:teuthology.orchestra.run.smithi089.stdout:(12/32): python3-more-itertools-7.2.0-3.el8.noa 1.0 MB/s | 59 kB 00:00 2023-01-25T06:14:52.651 INFO:teuthology.orchestra.run.smithi089.stdout:(13/32): python3-pecan-1.3.2-9.el8.noarch.rpm 4.8 MB/s | 283 kB 00:00 2023-01-25T06:14:52.710 INFO:teuthology.orchestra.run.smithi089.stdout:(14/32): python3-portend-2.6-1.el8.noarch.rpm 268 kB/s | 16 kB 00:00 2023-01-25T06:14:52.768 INFO:teuthology.orchestra.run.smithi089.stdout:(15/32): python3-simplegeneric-0.8.1-17.el8.noa 321 kB/s | 19 kB 00:00 2023-01-25T06:14:52.827 INFO:teuthology.orchestra.run.smithi089.stdout:(16/32): python3-singledispatch-3.4.0.3-18.el8. 410 kB/s | 24 kB 00:00 2023-01-25T06:14:52.885 INFO:teuthology.orchestra.run.smithi089.stdout:(17/32): python3-tempora-1.14.1-5.el8.noarch.rp 501 kB/s | 29 kB 00:00 2023-01-25T06:14:52.944 INFO:teuthology.orchestra.run.smithi089.stdout:(18/32): python3-trustme-0.6.0-4.el8.noarch.rpm 474 kB/s | 27 kB 00:00 2023-01-25T06:14:53.003 INFO:teuthology.orchestra.run.smithi089.stdout:(19/32): python3-waitress-1.2.1-2.el8.1.noarch. 4.0 MB/s | 241 kB 00:00 2023-01-25T06:14:53.061 INFO:teuthology.orchestra.run.smithi089.stdout:(20/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 4.2 MB/s | 251 kB 00:00 2023-01-25T06:14:53.120 INFO:teuthology.orchestra.run.smithi089.stdout:(21/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.4 MB/s | 85 kB 00:00 2023-01-25T06:14:53.170 INFO:teuthology.orchestra.run.smithi089.stdout:(22/32): python3-zc-lockfile-2.0-2.el8.noarch.r 459 kB/s | 23 kB 00:00 2023-01-25T06:14:53.221 INFO:teuthology.orchestra.run.smithi089.stdout:(23/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.7 MB/s | 238 kB 00:00 2023-01-25T06:14:53.254 INFO:teuthology.orchestra.run.smithi089.stdout:(24/32): python3-pycparser-2.14-14.el8.noarch.r 3.2 MB/s | 109 kB 00:00 2023-01-25T06:14:53.296 INFO:teuthology.orchestra.run.smithi089.stdout:(25/32): python3-cryptography-3.2.1-5.el8.x86_6 13 MB/s | 559 kB 00:00 2023-01-25T06:14:53.321 INFO:teuthology.orchestra.run.smithi089.stdout:(26/32): python3-pytz-2017.2-9.el8.noarch.rpm 2.1 MB/s | 54 kB 00:00 2023-01-25T06:14:53.346 INFO:teuthology.orchestra.run.smithi089.stdout:(27/32): python3-markupsafe-0.23-19.el8.x86_64. 1.5 MB/s | 39 kB 00:00 2023-01-25T06:14:53.397 INFO:teuthology.orchestra.run.smithi089.stdout:(28/32): python3-mako-1.0.6-13.el8.noarch.rpm 3.1 MB/s | 157 kB 00:00 2023-01-25T06:14:53.439 INFO:teuthology.orchestra.run.smithi089.stdout:(29/32): python3-werkzeug-0.12.2-4.el8.noarch.r 11 MB/s | 457 kB 00:00 2023-01-25T06:14:53.464 INFO:teuthology.orchestra.run.smithi089.stdout:(30/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 4.1 MB/s | 103 kB 00:00 2023-01-25T06:14:54.481 INFO:teuthology.orchestra.run.smithi089.stdout:(31/32): ceph-mon-18.0.0-1963.g61996d73.el8.x86 900 kB/s | 3.9 MB 00:04 2023-01-25T06:14:54.808 INFO:teuthology.orchestra.run.smithi088.stdout:(32/32): ceph-osd-18.0.0-1963.g61996d73.el8.x86 3.3 MB/s | 17 MB 00:05 2023-01-25T06:14:54.810 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:14:54.810 INFO:teuthology.orchestra.run.smithi088.stdout:Total 4.5 MB/s | 28 MB 00:06 2023-01-25T06:14:54.900 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T06:14:54.938 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T06:14:54.939 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T06:14:55.140 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T06:14:55.144 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T06:14:56.228 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T06:14:56.472 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-01-25T06:14:56.712 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-01-25T06:14:56.910 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 3/32 2023-01-25T06:14:57.296 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 4/32 2023-01-25T06:14:57.587 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 5/32 2023-01-25T06:14:57.758 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 6/32 2023-01-25T06:14:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 7/32 2023-01-25T06:14:58.448 INFO:teuthology.orchestra.run.smithi089.stdout:(32/32): ceph-osd-18.0.0-1963.g61996d73.el8.x86 2.4 MB/s | 17 MB 00:07 2023-01-25T06:14:58.450 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:14:58.450 INFO:teuthology.orchestra.run.smithi089.stdout:Total 3.2 MB/s | 28 MB 00:08 2023-01-25T06:14:58.543 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T06:14:58.581 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T06:14:58.581 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T06:14:58.764 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 8/32 2023-01-25T06:14:58.783 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T06:14:58.787 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T06:14:58.988 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 9/32 2023-01-25T06:14:59.212 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 10/32 2023-01-25T06:14:59.449 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 11/32 2023-01-25T06:14:59.616 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 12/32 2023-01-25T06:14:59.816 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 13/32 2023-01-25T06:14:59.873 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T06:15:00.010 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 14/32 2023-01-25T06:15:00.083 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-01-25T06:15:00.162 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 15/32 2023-01-25T06:15:00.302 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 16/32 2023-01-25T06:15:00.394 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-01-25T06:15:00.453 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 17/32 2023-01-25T06:15:00.581 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 18/32 2023-01-25T06:15:00.606 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 3/32 2023-01-25T06:15:00.829 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 4/32 2023-01-25T06:15:00.844 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 19/32 2023-01-25T06:15:01.061 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 20/32 2023-01-25T06:15:01.074 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 5/32 2023-01-25T06:15:01.264 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-01-25T06:15:01.281 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 6/32 2023-01-25T06:15:01.496 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 7/32 2023-01-25T06:15:01.518 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-01-25T06:15:01.779 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-01-25T06:15:01.857 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 8/32 2023-01-25T06:15:01.991 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 24/32 2023-01-25T06:15:02.181 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 9/32 2023-01-25T06:15:02.316 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 25/32 2023-01-25T06:15:02.327 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 10/32 2023-01-25T06:15:02.529 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 11/32 2023-01-25T06:15:02.643 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-01-25T06:15:02.745 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 12/32 2023-01-25T06:15:02.945 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-1963.g61996d73.el8. 27/32 2023-01-25T06:15:02.950 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 13/32 2023-01-25T06:15:03.118 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 14/32 2023-01-25T06:15:03.126 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 28/32 2023-01-25T06:15:03.324 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 15/32 2023-01-25T06:15:03.497 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 16/32 2023-01-25T06:15:03.647 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 17/32 2023-01-25T06:15:03.792 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 18/32 2023-01-25T06:15:04.030 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 19/32 2023-01-25T06:15:04.231 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 20/32 2023-01-25T06:15:04.392 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-01-25T06:15:04.615 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 28/32 2023-01-25T06:15:04.680 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-01-25T06:15:04.792 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 29/32 2023-01-25T06:15:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-01-25T06:15:05.145 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 24/32 2023-01-25T06:15:05.174 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 29/32 2023-01-25T06:15:05.341 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 30/32 2023-01-25T06:15:05.483 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 25/32 2023-01-25T06:15:05.553 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 30/32 2023-01-25T06:15:05.733 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 31/32 2023-01-25T06:15:05.750 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 31/32 2023-01-25T06:15:05.824 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-01-25T06:15:05.855 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-2:18.0.0-1963.g61996d73.el8.x86_64 32/32 2023-01-25T06:15:06.120 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-1963.g61996d73.el8. 27/32 2023-01-25T06:15:06.183 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-2:18.0.0-1963.g61996d73.el8.x86_64 32/32 2023-01-25T06:15:06.183 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-2:18.0.0-1963.g61996d73.el8.x86_64 1/32 2023-01-25T06:15:06.183 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 2/32 2023-01-25T06:15:06.184 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 3/32 2023-01-25T06:15:06.184 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 4/32 2023-01-25T06:15:06.184 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 5/32 2023-01-25T06:15:06.184 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-1963.g61996d73.el8. 6/32 2023-01-25T06:15:06.184 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 7/32 2023-01-25T06:15:06.185 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 8/32 2023-01-25T06:15:06.185 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 9/32 2023-01-25T06:15:06.185 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 10/32 2023-01-25T06:15:06.185 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 11/32 2023-01-25T06:15:06.185 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 12/32 2023-01-25T06:15:06.186 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 13/32 2023-01-25T06:15:06.186 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 14/32 2023-01-25T06:15:06.186 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 15/32 2023-01-25T06:15:06.186 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-portend-2.6-1.el8.noarch 16/32 2023-01-25T06:15:06.186 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 17/32 2023-01-25T06:15:06.187 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 18/32 2023-01-25T06:15:06.187 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 19/32 2023-01-25T06:15:06.187 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 20/32 2023-01-25T06:15:06.187 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 21/32 2023-01-25T06:15:06.187 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 22/32 2023-01-25T06:15:06.188 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 23/32 2023-01-25T06:15:06.188 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 24/32 2023-01-25T06:15:06.188 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 25/32 2023-01-25T06:15:06.188 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 26/32 2023-01-25T06:15:06.188 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 27/32 2023-01-25T06:15:06.189 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 28/32 2023-01-25T06:15:06.189 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 29/32 2023-01-25T06:15:06.189 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 30/32 2023-01-25T06:15:06.190 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 31/32 2023-01-25T06:15:06.276 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 28/32 2023-01-25T06:15:07.597 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 32/32 2023-01-25T06:15:07.598 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:33 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:15:07.763 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 28/32 2023-01-25T06:15:07.968 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 29/32 2023-01-25T06:15:08.351 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 29/32 2023-01-25T06:15:08.869 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 30/32 2023-01-25T06:15:09.083 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 30/32 2023-01-25T06:15:09.269 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 31/32 2023-01-25T06:15:09.287 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 31/32 2023-01-25T06:15:09.425 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-2:18.0.0-1963.g61996d73.el8.x86_64 32/32 2023-01-25T06:15:09.769 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-2:18.0.0-1963.g61996d73.el8.x86_64 32/32 2023-01-25T06:15:09.769 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-2:18.0.0-1963.g61996d73.el8.x86_64 1/32 2023-01-25T06:15:09.769 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 2/32 2023-01-25T06:15:09.770 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 3/32 2023-01-25T06:15:09.770 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 4/32 2023-01-25T06:15:09.770 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 5/32 2023-01-25T06:15:09.771 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-1963.g61996d73.el8. 6/32 2023-01-25T06:15:09.771 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 7/32 2023-01-25T06:15:09.771 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 8/32 2023-01-25T06:15:09.772 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 9/32 2023-01-25T06:15:09.772 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 10/32 2023-01-25T06:15:09.773 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 11/32 2023-01-25T06:15:09.773 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 12/32 2023-01-25T06:15:09.774 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 13/32 2023-01-25T06:15:09.774 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 14/32 2023-01-25T06:15:09.774 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 15/32 2023-01-25T06:15:09.774 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-portend-2.6-1.el8.noarch 16/32 2023-01-25T06:15:09.775 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 17/32 2023-01-25T06:15:09.775 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 18/32 2023-01-25T06:15:09.775 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 19/32 2023-01-25T06:15:09.775 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 20/32 2023-01-25T06:15:09.775 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 21/32 2023-01-25T06:15:09.776 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 22/32 2023-01-25T06:15:09.776 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 23/32 2023-01-25T06:15:09.776 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 24/32 2023-01-25T06:15:09.777 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 25/32 2023-01-25T06:15:09.777 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 26/32 2023-01-25T06:15:09.777 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 27/32 2023-01-25T06:15:09.777 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 28/32 2023-01-25T06:15:09.777 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 29/32 2023-01-25T06:15:09.778 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 30/32 2023-01-25T06:15:09.778 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 31/32 2023-01-25T06:15:09.877 INFO:teuthology.orchestra.run.smithi088.stdout:Installed products updated. 2023-01-25T06:15:10.064 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:15:10.064 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T06:15:10.065 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:15:10.065 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:15:10.066 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:15:10.066 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:15:10.066 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:15:10.067 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:15:10.067 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-01-25T06:15:10.067 INFO:teuthology.orchestra.run.smithi088.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-01-25T06:15:10.068 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-01-25T06:15:10.068 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-01-25T06:15:10.068 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-01-25T06:15:10.069 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-01-25T06:15:10.069 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-6.2-6.el8.noarch 2023-01-25T06:15:10.069 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-01-25T06:15:10.070 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-01-25T06:15:10.070 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako-1.0.6-13.el8.noarch 2023-01-25T06:15:10.071 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-01-25T06:15:10.071 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-01-25T06:15:10.071 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-01-25T06:15:10.071 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend-2.6-1.el8.noarch 2023-01-25T06:15:10.072 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-01-25T06:15:10.072 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser-2.14-14.el8.noarch 2023-01-25T06:15:10.072 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz-2017.2-9.el8.noarch 2023-01-25T06:15:10.072 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-01-25T06:15:10.072 INFO:teuthology.orchestra.run.smithi088.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-01-25T06:15:10.073 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-01-25T06:15:10.073 INFO:teuthology.orchestra.run.smithi088.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-01-25T06:15:10.073 INFO:teuthology.orchestra.run.smithi088.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-01-25T06:15:10.073 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-01-25T06:15:10.073 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-01-25T06:15:10.074 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-01-25T06:15:10.074 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-01-25T06:15:10.074 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:15:10.074 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T06:15:10.227 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-base 2023-01-25T06:15:10.572 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:15:11.231 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 32/32 2023-01-25T06:15:11.231 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:37 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:15:11.374 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:37 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:15:12.650 INFO:teuthology.orchestra.run.smithi088.stdout:Package ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:15:12.755 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T06:15:12.756 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-01-25T06:15:12.757 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T06:15:12.881 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install cephadm 2023-01-25T06:15:13.223 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:15:13.622 INFO:teuthology.orchestra.run.smithi089.stdout:Installed products updated. 2023-01-25T06:15:13.804 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:15:13.804 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T06:15:13.805 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:15:13.805 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:15:13.805 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:15:13.805 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:15:13.805 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:15:13.806 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:15:13.806 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-01-25T06:15:13.806 INFO:teuthology.orchestra.run.smithi089.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-01-25T06:15:13.806 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-01-25T06:15:13.806 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-01-25T06:15:13.807 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-01-25T06:15:13.807 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-01-25T06:15:13.807 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-6.2-6.el8.noarch 2023-01-25T06:15:13.807 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-01-25T06:15:13.807 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-01-25T06:15:13.808 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako-1.0.6-13.el8.noarch 2023-01-25T06:15:13.808 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-01-25T06:15:13.808 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-01-25T06:15:13.808 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-01-25T06:15:13.808 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend-2.6-1.el8.noarch 2023-01-25T06:15:13.809 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-01-25T06:15:13.809 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser-2.14-14.el8.noarch 2023-01-25T06:15:13.809 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz-2017.2-9.el8.noarch 2023-01-25T06:15:13.809 INFO:teuthology.orchestra.run.smithi089.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-01-25T06:15:13.809 INFO:teuthology.orchestra.run.smithi089.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-01-25T06:15:13.810 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-01-25T06:15:13.810 INFO:teuthology.orchestra.run.smithi089.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-01-25T06:15:13.810 INFO:teuthology.orchestra.run.smithi089.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-01-25T06:15:13.810 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-01-25T06:15:13.810 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-01-25T06:15:13.811 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-01-25T06:15:13.811 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-01-25T06:15:13.811 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:15:13.811 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T06:15:13.943 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-base 2023-01-25T06:15:14.016 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:40 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:15:14.289 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:15:15.116 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:41 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:15:15.386 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T06:15:15.388 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T06:15:15.388 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-01-25T06:15:15.388 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T06:15:15.389 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T06:15:15.389 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 82 k 2023-01-25T06:15:15.389 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:15:15.389 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T06:15:15.390 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T06:15:15.390 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-01-25T06:15:15.390 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:15:15.390 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 82 k 2023-01-25T06:15:15.390 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 374 k 2023-01-25T06:15:15.391 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T06:15:15.795 INFO:teuthology.orchestra.run.smithi088.stdout:cephadm-18.0.0-1963.g61996d73.el8.noarch.rpm 202 kB/s | 82 kB 00:00 2023-01-25T06:15:15.796 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:15:15.796 INFO:teuthology.orchestra.run.smithi088.stdout:Total 201 kB/s | 82 kB 00:00 2023-01-25T06:15:15.797 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T06:15:15.806 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T06:15:15.806 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T06:15:15.808 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T06:15:15.812 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T06:15:15.859 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T06:15:16.401 INFO:teuthology.orchestra.run.smithi089.stdout:Package ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:15:16.508 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T06:15:16.509 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-01-25T06:15:16.509 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T06:15:16.624 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install cephadm 2023-01-25T06:15:16.965 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:15:17.417 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:15:17.552 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:15:17.718 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:15:17.742 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:43 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:15:18.747 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:15:18.747 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:44 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:15:19.114 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T06:15:19.115 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T06:15:19.115 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-01-25T06:15:19.116 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T06:15:19.116 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T06:15:19.116 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 82 k 2023-01-25T06:15:19.117 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:15:19.117 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T06:15:19.117 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T06:15:19.117 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2023-01-25T06:15:19.117 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:15:19.118 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 82 k 2023-01-25T06:15:19.118 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 374 k 2023-01-25T06:15:19.118 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T06:15:19.296 INFO:teuthology.orchestra.run.smithi089.stdout:cephadm-18.0.0-1963.g61996d73.el8.noarch.rpm 456 kB/s | 82 kB 00:00 2023-01-25T06:15:19.297 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:15:19.297 INFO:teuthology.orchestra.run.smithi089.stdout:Total 453 kB/s | 82 kB 00:00 2023-01-25T06:15:19.297 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T06:15:19.305 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T06:15:19.305 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T06:15:19.307 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T06:15:19.310 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T06:15:19.349 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T06:15:21.022 INFO:teuthology.orchestra.run.smithi088.stdout:Installed products updated. 2023-01-25T06:15:21.203 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:15:21.203 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T06:15:21.204 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:15:21.204 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:15:21.204 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T06:15:21.304 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:15:21.478 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:15:21.648 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:15:21.683 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-immutable-object-cache 2023-01-25T06:15:22.039 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:15:22.730 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:15:22.730 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:48 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:15:22.859 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:48 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:15:24.284 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T06:15:24.285 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T06:15:24.286 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repo Size 2023-01-25T06:15:24.286 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T06:15:24.286 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T06:15:24.287 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-1963.g61996d73.el8 ceph 165 k 2023-01-25T06:15:24.287 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:15:24.287 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T06:15:24.288 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T06:15:24.288 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-01-25T06:15:24.289 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:15:24.289 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 165 k 2023-01-25T06:15:24.289 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 503 k 2023-01-25T06:15:24.290 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T06:15:24.749 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-immutable-object-cache-18.0.0-1963.g61996d 356 kB/s | 165 kB 00:00 2023-01-25T06:15:24.750 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:15:24.750 INFO:teuthology.orchestra.run.smithi088.stdout:Total 355 kB/s | 165 kB 00:00 2023-01-25T06:15:24.751 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T06:15:24.762 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T06:15:24.762 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T06:15:24.814 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T06:15:24.818 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T06:15:24.933 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T06:15:25.112 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-1963.g61996d73. 1/1 2023-01-25T06:15:25.326 INFO:teuthology.orchestra.run.smithi089.stdout:Installed products updated. 2023-01-25T06:15:25.474 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-1963.g61996d73. 1/1 2023-01-25T06:15:25.504 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:15:25.504 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T06:15:25.504 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:15:25.504 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:15:25.505 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T06:15:25.654 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-immutable-object-cache 2023-01-25T06:15:26.009 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:15:26.512 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-1963.g61996d73. 1/1 2023-01-25T06:15:26.512 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:52 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:15:26.826 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:52 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:15:28.222 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T06:15:28.222 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T06:15:28.222 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2023-01-25T06:15:28.222 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T06:15:28.223 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T06:15:28.223 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-1963.g61996d73.el8 ceph 165 k 2023-01-25T06:15:28.223 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:15:28.223 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T06:15:28.223 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T06:15:28.224 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2023-01-25T06:15:28.224 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:15:28.224 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 165 k 2023-01-25T06:15:28.224 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 503 k 2023-01-25T06:15:28.224 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T06:15:28.426 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-immutable-object-cache-18.0.0-1963.g61996d 809 kB/s | 165 kB 00:00 2023-01-25T06:15:28.426 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:15:28.427 INFO:teuthology.orchestra.run.smithi089.stdout:Total 804 kB/s | 165 kB 00:00 2023-01-25T06:15:28.427 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T06:15:28.438 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T06:15:28.438 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T06:15:28.490 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T06:15:28.494 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T06:15:28.609 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T06:15:28.749 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-1963.g61996d73. 1/1 2023-01-25T06:15:28.822 INFO:teuthology.orchestra.run.smithi088.stdout:Installed products updated. 2023-01-25T06:15:29.003 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:15:29.004 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T06:15:29.004 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:15:29.004 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:15:29.005 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T06:15:29.105 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-1963.g61996d73. 1/1 2023-01-25T06:15:29.125 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-mgr 2023-01-25T06:15:29.468 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:15:30.142 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-1963.g61996d73. 1/1 2023-01-25T06:15:30.143 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:56 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:15:30.237 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:56 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:15:31.512 INFO:teuthology.orchestra.run.smithi088.stdout:Package ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:15:31.619 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T06:15:31.620 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-01-25T06:15:31.621 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T06:15:31.742 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-mgr-dashboard 2023-01-25T06:15:32.087 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:15:32.511 INFO:teuthology.orchestra.run.smithi089.stdout:Installed products updated. 2023-01-25T06:15:32.696 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:15:32.696 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T06:15:32.696 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:15:32.697 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:15:32.697 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T06:15:32.825 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr 2023-01-25T06:15:32.893 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:58 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:15:33.170 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:15:33.950 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:59 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:15:34.274 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T06:15:34.275 INFO:teuthology.orchestra.run.smithi088.stdout:=================================================================================================== 2023-01-25T06:15:34.276 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-01-25T06:15:34.276 INFO:teuthology.orchestra.run.smithi088.stdout:=================================================================================================== 2023-01-25T06:15:34.276 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T06:15:34.276 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 1.7 M 2023-01-25T06:15:34.276 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-01-25T06:15:34.277 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 23 k 2023-01-25T06:15:34.277 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 15 k 2023-01-25T06:15:34.277 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-01-25T06:15:34.277 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-01-25T06:15:34.277 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-01-25T06:15:34.278 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:15:34.278 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T06:15:34.278 INFO:teuthology.orchestra.run.smithi088.stdout:=================================================================================================== 2023-01-25T06:15:34.278 INFO:teuthology.orchestra.run.smithi088.stdout:Install 6 Packages 2023-01-25T06:15:34.278 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:15:34.279 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 2.0 M 2023-01-25T06:15:34.279 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 8.2 M 2023-01-25T06:15:34.279 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T06:15:34.437 INFO:teuthology.orchestra.run.smithi088.stdout:(1/6): ceph-grafana-dashboards-18.0.0-1963.g619 145 kB/s | 23 kB 00:00 2023-01-25T06:15:34.462 INFO:teuthology.orchestra.run.smithi088.stdout:(2/6): ceph-prometheus-alerts-18.0.0-1963.g6199 79 kB/s | 15 kB 00:00 2023-01-25T06:15:34.595 INFO:teuthology.orchestra.run.smithi088.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 212 kB/s | 34 kB 00:00 2023-01-25T06:15:34.637 INFO:teuthology.orchestra.run.smithi088.stdout:(4/6): ceph-mgr-dashboard-18.0.0-1963.g61996d73 4.8 MB/s | 1.7 MB 00:00 2023-01-25T06:15:34.671 INFO:teuthology.orchestra.run.smithi088.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 942 kB/s | 196 kB 00:00 2023-01-25T06:15:34.696 INFO:teuthology.orchestra.run.smithi088.stdout:(6/6): python3-jwt-1.6.1-2.el8.noarch.rpm 424 kB/s | 43 kB 00:00 2023-01-25T06:15:34.698 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:15:34.698 INFO:teuthology.orchestra.run.smithi088.stdout:Total 4.8 MB/s | 2.0 MB 00:00 2023-01-25T06:15:34.709 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T06:15:34.718 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T06:15:34.718 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T06:15:34.774 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T06:15:34.778 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T06:15:35.019 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T06:15:35.210 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 1/6 2023-01-25T06:15:35.244 INFO:teuthology.orchestra.run.smithi089.stdout:Package ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:15:35.350 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T06:15:35.351 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-01-25T06:15:35.351 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T06:15:35.373 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 2/6 2023-01-25T06:15:35.459 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-dashboard 2023-01-25T06:15:35.528 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 3/6 2023-01-25T06:15:35.665 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-1963.g61996d73.el8.n 4/6 2023-01-25T06:15:35.800 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:15:36.022 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-1963.g61996d73.el8. 5/6 2023-01-25T06:15:36.241 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarc 6/6 2023-01-25T06:15:36.471 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarc 6/6 2023-01-25T06:15:36.471 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-1963.g61996d73.el8. 1/6 2023-01-25T06:15:36.471 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarc 2/6 2023-01-25T06:15:36.472 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-1963.g61996d73.el8.n 3/6 2023-01-25T06:15:36.472 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/6 2023-01-25T06:15:36.472 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/6 2023-01-25T06:15:36.594 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:02:02 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:15:37.492 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 6/6 2023-01-25T06:15:37.492 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:03 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:15:37.989 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T06:15:37.990 INFO:teuthology.orchestra.run.smithi089.stdout:=================================================================================================== 2023-01-25T06:15:37.990 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-01-25T06:15:37.991 INFO:teuthology.orchestra.run.smithi089.stdout:=================================================================================================== 2023-01-25T06:15:37.991 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T06:15:37.991 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 1.7 M 2023-01-25T06:15:37.991 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-01-25T06:15:37.991 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 23 k 2023-01-25T06:15:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 15 k 2023-01-25T06:15:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-01-25T06:15:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-01-25T06:15:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-01-25T06:15:37.992 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:15:37.992 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T06:15:37.993 INFO:teuthology.orchestra.run.smithi089.stdout:=================================================================================================== 2023-01-25T06:15:37.993 INFO:teuthology.orchestra.run.smithi089.stdout:Install 6 Packages 2023-01-25T06:15:37.993 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:15:37.994 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 2.0 M 2023-01-25T06:15:37.994 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 8.2 M 2023-01-25T06:15:37.994 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T06:15:38.149 INFO:teuthology.orchestra.run.smithi089.stdout:(1/6): ceph-grafana-dashboards-18.0.0-1963.g619 147 kB/s | 23 kB 00:00 2023-01-25T06:15:38.166 INFO:teuthology.orchestra.run.smithi089.stdout:(2/6): ceph-prometheus-alerts-18.0.0-1963.g6199 84 kB/s | 15 kB 00:00 2023-01-25T06:15:38.282 INFO:teuthology.orchestra.run.smithi089.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 252 kB/s | 34 kB 00:00 2023-01-25T06:15:38.333 INFO:teuthology.orchestra.run.smithi089.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 850 kB/s | 43 kB 00:00 2023-01-25T06:15:38.375 INFO:teuthology.orchestra.run.smithi089.stdout:(5/6): ceph-mgr-dashboard-18.0.0-1963.g61996d73 4.5 MB/s | 1.7 MB 00:00 2023-01-25T06:15:38.400 INFO:teuthology.orchestra.run.smithi089.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 839 kB/s | 196 kB 00:00 2023-01-25T06:15:38.401 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:15:38.402 INFO:teuthology.orchestra.run.smithi089.stdout:Total 4.9 MB/s | 2.0 MB 00:00 2023-01-25T06:15:38.412 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T06:15:38.421 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T06:15:38.422 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T06:15:38.477 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T06:15:38.481 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T06:15:38.756 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T06:15:38.915 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 1/6 2023-01-25T06:15:39.095 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 2/6 2023-01-25T06:15:39.292 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 3/6 2023-01-25T06:15:39.445 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-1963.g61996d73.el8.n 4/6 2023-01-25T06:15:39.800 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-1963.g61996d73.el8. 5/6 2023-01-25T06:15:39.819 INFO:teuthology.orchestra.run.smithi088.stdout:Installed products updated. 2023-01-25T06:15:40.000 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:15:40.000 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T06:15:40.001 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:15:40.001 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:15:40.001 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:15:40.001 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-01-25T06:15:40.001 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-01-25T06:15:40.002 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes-2.4.1-12.el8.noarch 2023-01-25T06:15:40.002 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:15:40.002 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T06:15:40.087 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarc 6/6 2023-01-25T06:15:40.146 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-mgr-diskprediction-local 2023-01-25T06:15:40.319 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarc 6/6 2023-01-25T06:15:40.320 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-1963.g61996d73.el8. 1/6 2023-01-25T06:15:40.320 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarc 2/6 2023-01-25T06:15:40.320 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-1963.g61996d73.el8.n 3/6 2023-01-25T06:15:40.320 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/6 2023-01-25T06:15:40.321 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/6 2023-01-25T06:15:40.491 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:15:41.282 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:07 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:15:41.345 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 6/6 2023-01-25T06:15:41.345 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:02:07 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:15:42.699 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T06:15:42.700 INFO:teuthology.orchestra.run.smithi088.stdout:======================================================================================================================= 2023-01-25T06:15:42.701 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-01-25T06:15:42.701 INFO:teuthology.orchestra.run.smithi088.stdout:======================================================================================================================= 2023-01-25T06:15:42.701 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T06:15:42.701 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 7.4 M 2023-01-25T06:15:42.701 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-01-25T06:15:42.702 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-01-25T06:15:42.702 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-01-25T06:15:42.702 INFO:teuthology.orchestra.run.smithi088.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-01-25T06:15:42.703 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-01-25T06:15:42.703 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-01-25T06:15:42.703 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-01-25T06:15:42.703 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-01-25T06:15:42.703 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:15:42.704 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T06:15:42.704 INFO:teuthology.orchestra.run.smithi088.stdout:======================================================================================================================= 2023-01-25T06:15:42.704 INFO:teuthology.orchestra.run.smithi088.stdout:Install 8 Packages 2023-01-25T06:15:42.704 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:15:42.705 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 35 M 2023-01-25T06:15:42.705 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 210 M 2023-01-25T06:15:42.705 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T06:15:42.878 INFO:teuthology.orchestra.run.smithi088.stdout:(1/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 21 MB/s | 3.7 MB 00:00 2023-01-25T06:15:42.911 INFO:teuthology.orchestra.run.smithi088.stdout:(2/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 6.7 MB/s | 225 kB 00:00 2023-01-25T06:15:43.103 INFO:teuthology.orchestra.run.smithi088.stdout:(3/8): python3-scipy-1.0.0-21.module+el8.5.0+10 34 MB/s | 14 MB 00:00 2023-01-25T06:15:43.178 INFO:teuthology.orchestra.run.smithi088.stdout:(4/8): openblas-threads-0.3.15-3.el8.x86_64.rpm 18 MB/s | 4.9 MB 00:00 2023-01-25T06:15:43.237 INFO:teuthology.orchestra.run.smithi088.stdout:(5/8): libgfortran-8.5.0-10.1.el8_6.x86_64.rpm 11 MB/s | 644 kB 00:00 2023-01-25T06:15:43.279 INFO:teuthology.orchestra.run.smithi088.stdout:(6/8): libquadmath-8.5.0-10.1.el8_6.x86_64.rpm 4.0 MB/s | 171 kB 00:00 2023-01-25T06:15:43.354 INFO:teuthology.orchestra.run.smithi088.stdout:(7/8): openblas-0.3.15-3.el8.x86_64.rpm 19 MB/s | 4.7 MB 00:00 2023-01-25T06:15:43.673 INFO:teuthology.orchestra.run.smithi089.stdout:Installed products updated. 2023-01-25T06:15:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:15:43.854 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T06:15:43.854 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:15:43.855 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:15:43.855 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:15:43.855 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-01-25T06:15:43.856 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-01-25T06:15:43.856 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes-2.4.1-12.el8.noarch 2023-01-25T06:15:43.856 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:15:43.857 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T06:15:43.992 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-diskprediction-local 2023-01-25T06:15:44.004 INFO:teuthology.orchestra.run.smithi088.stdout:(8/8): ceph-mgr-diskprediction-local-18.0.0-196 5.7 MB/s | 7.4 MB 00:01 2023-01-25T06:15:44.005 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:15:44.005 INFO:teuthology.orchestra.run.smithi088.stdout:Total 27 MB/s | 35 MB 00:01 2023-01-25T06:15:44.242 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T06:15:44.260 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T06:15:44.261 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T06:15:44.336 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:15:44.551 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T06:15:44.555 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T06:15:45.112 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T06:15:45.122 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:02:11 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:15:45.265 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 1/8 2023-01-25T06:15:45.398 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 1/8 2023-01-25T06:15:45.532 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 2/8 2023-01-25T06:15:46.143 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 2/8 2023-01-25T06:15:46.315 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 3/8 2023-01-25T06:15:46.543 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T06:15:46.544 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================================================= 2023-01-25T06:15:46.545 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-01-25T06:15:46.545 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================================================= 2023-01-25T06:15:46.545 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T06:15:46.545 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 7.4 M 2023-01-25T06:15:46.545 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-01-25T06:15:46.546 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-01-25T06:15:46.546 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-01-25T06:15:46.546 INFO:teuthology.orchestra.run.smithi089.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-01-25T06:15:46.546 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-01-25T06:15:46.546 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-01-25T06:15:46.547 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-01-25T06:15:46.547 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-01-25T06:15:46.547 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:15:46.547 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T06:15:46.547 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================================================= 2023-01-25T06:15:46.548 INFO:teuthology.orchestra.run.smithi089.stdout:Install 8 Packages 2023-01-25T06:15:46.548 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:15:46.548 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 35 M 2023-01-25T06:15:46.549 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 210 M 2023-01-25T06:15:46.549 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T06:15:46.623 INFO:teuthology.orchestra.run.smithi089.stdout:(1/8): libgfortran-8.5.0-10.1.el8_6.x86_64.rpm 8.3 MB/s | 644 kB 00:00 2023-01-25T06:15:46.648 INFO:teuthology.orchestra.run.smithi089.stdout:(2/8): libquadmath-8.5.0-10.1.el8_6.x86_64.rpm 1.7 MB/s | 171 kB 00:00 2023-01-25T06:15:46.757 INFO:teuthology.orchestra.run.smithi089.stdout:(3/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 35 MB/s | 3.7 MB 00:00 2023-01-25T06:15:46.799 INFO:teuthology.orchestra.run.smithi089.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 5.3 MB/s | 225 kB 00:00 2023-01-25T06:15:46.910 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 3/8 2023-01-25T06:15:46.932 INFO:teuthology.orchestra.run.smithi089.stdout:(5/8): openblas-threads-0.3.15-3.el8.x86_64.rpm 36 MB/s | 4.9 MB 00:00 2023-01-25T06:15:47.083 INFO:teuthology.orchestra.run.smithi089.stdout:(6/8): python3-scipy-1.0.0-21.module+el8.5.0+10 30 MB/s | 14 MB 00:00 2023-01-25T06:15:47.106 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-0.3.15-3.el8.x86_64 4/8 2023-01-25T06:15:47.191 INFO:teuthology.orchestra.run.smithi089.stdout:(7/8): openblas-0.3.15-3.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2023-01-25T06:15:47.333 INFO:teuthology.orchestra.run.smithi089.stdout:(8/8): ceph-mgr-diskprediction-local-18.0.0-196 9.4 MB/s | 7.4 MB 00:00 2023-01-25T06:15:47.334 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:15:47.335 INFO:teuthology.orchestra.run.smithi089.stdout:Total 45 MB/s | 35 MB 00:00 2023-01-25T06:15:47.574 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T06:15:47.592 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T06:15:47.593 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T06:15:47.784 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 4/8 2023-01-25T06:15:47.883 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T06:15:47.886 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T06:15:48.430 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T06:15:48.490 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-01-25T06:15:48.579 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 1/8 2023-01-25T06:15:48.689 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-25T06:15:48.724 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 1/8 2023-01-25T06:15:48.879 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 2/8 2023-01-25T06:15:49.482 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 2/8 2023-01-25T06:15:49.688 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 3/8 2023-01-25T06:15:50.267 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 3/8 2023-01-25T06:15:50.437 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-0.3.15-3.el8.x86_64 4/8 2023-01-25T06:15:50.481 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-25T06:15:51.112 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 4/8 2023-01-25T06:15:51.431 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-01-25T06:15:51.637 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-25T06:15:51.723 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d 7/8 2023-01-25T06:15:51.888 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d7 8/8 2023-01-25T06:15:52.151 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d7 8/8 2023-01-25T06:15:52.152 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d7 1/8 2023-01-25T06:15:52.152 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d 2/8 2023-01-25T06:15:52.152 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 3/8 2023-01-25T06:15:52.153 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 4/8 2023-01-25T06:15:52.153 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 5/8 2023-01-25T06:15:52.153 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 6/8 2023-01-25T06:15:52.153 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 7/8 2023-01-25T06:15:53.193 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 8/8 2023-01-25T06:15:53.193 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:19 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:15:53.403 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-25T06:15:54.877 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d 7/8 2023-01-25T06:15:55.012 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d7 8/8 2023-01-25T06:15:55.268 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d7 8/8 2023-01-25T06:15:55.268 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d7 1/8 2023-01-25T06:15:55.268 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 2/8 2023-01-25T06:15:55.268 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 3/8 2023-01-25T06:15:55.269 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d 4/8 2023-01-25T06:15:55.269 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-01-25T06:15:55.269 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-25T06:15:55.269 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 7/8 2023-01-25T06:15:56.119 INFO:teuthology.orchestra.run.smithi088.stdout:Installed products updated. 2023-01-25T06:15:56.300 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:15:56.300 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T06:15:56.301 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:15:56.301 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-01-25T06:15:56.301 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-01-25T06:15:56.301 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-0.3.15-3.el8.x86_64 2023-01-25T06:15:56.301 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-01-25T06:15:56.302 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-01-25T06:15:56.302 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-01-25T06:15:56.302 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-01-25T06:15:56.302 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:15:56.302 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T06:15:56.314 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 8/8 2023-01-25T06:15:56.314 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:02:22 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:15:56.425 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-mgr-rook 2023-01-25T06:15:56.770 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:15:57.631 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:23 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:15:59.096 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T06:15:59.098 INFO:teuthology.orchestra.run.smithi088.stdout:======================================================================================================== 2023-01-25T06:15:59.098 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-01-25T06:15:59.098 INFO:teuthology.orchestra.run.smithi088.stdout:======================================================================================================== 2023-01-25T06:15:59.099 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T06:15:59.099 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 47 k 2023-01-25T06:15:59.099 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-01-25T06:15:59.099 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-01-25T06:15:59.100 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-01-25T06:15:59.100 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-01-25T06:15:59.100 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-01-25T06:15:59.100 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-01-25T06:15:59.101 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-01-25T06:15:59.101 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-01-25T06:15:59.101 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-01-25T06:15:59.101 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-01-25T06:15:59.101 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-01-25T06:15:59.102 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-01-25T06:15:59.102 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-01-25T06:15:59.102 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:15:59.102 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T06:15:59.102 INFO:teuthology.orchestra.run.smithi088.stdout:======================================================================================================== 2023-01-25T06:15:59.102 INFO:teuthology.orchestra.run.smithi088.stdout:Install 13 Packages 2023-01-25T06:15:59.103 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:15:59.103 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 1.9 M 2023-01-25T06:15:59.104 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 25 M 2023-01-25T06:15:59.104 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T06:15:59.233 INFO:teuthology.orchestra.run.smithi088.stdout:(1/13): python3-certifi-2018.10.15-7.el8.noarch 124 kB/s | 16 kB 00:00 2023-01-25T06:15:59.250 INFO:teuthology.orchestra.run.smithi088.stdout:(2/13): python3-cachetools-3.1.1-4.el8.noarch.r 222 kB/s | 33 kB 00:00 2023-01-25T06:15:59.317 INFO:teuthology.orchestra.run.smithi088.stdout:(3/13): python3-google-auth-1.1.1-10.el8.noarch 971 kB/s | 81 kB 00:00 2023-01-25T06:15:59.367 INFO:teuthology.orchestra.run.smithi088.stdout:(4/13): python3-rsa-4.8-1.el8.noarch.rpm 1.2 MB/s | 61 kB 00:00 2023-01-25T06:15:59.417 INFO:teuthology.orchestra.run.smithi088.stdout:(5/13): python3-websocket-client-0.56.0-5.el8.n 1.2 MB/s | 61 kB 00:00 2023-01-25T06:15:59.484 INFO:teuthology.orchestra.run.smithi088.stdout:(6/13): python3-pyasn1-modules-0.3.7-6.el8.noar 1.6 MB/s | 110 kB 00:00 2023-01-25T06:15:59.510 INFO:teuthology.orchestra.run.smithi088.stdout:(7/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 1.0 MB/s | 27 kB 00:00 2023-01-25T06:15:59.552 INFO:teuthology.orchestra.run.smithi088.stdout:(8/13): python3-kubernetes-11.0.0-6.el8.noarch. 3.9 MB/s | 1.2 MB 00:00 2023-01-25T06:15:59.577 INFO:teuthology.orchestra.run.smithi088.stdout:(9/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.8 MB/s | 126 kB 00:00 2023-01-25T06:15:59.602 INFO:teuthology.orchestra.run.smithi088.stdout:(10/13): ceph-mgr-rook-18.0.0-1963.g61996d73.el 94 kB/s | 47 kB 00:00 2023-01-25T06:15:59.619 INFO:teuthology.orchestra.run.smithi088.stdout:(11/13): python3-jsonpointer-1.10-11.el8.noarch 297 kB/s | 20 kB 00:00 2023-01-25T06:15:59.644 INFO:teuthology.orchestra.run.smithi088.stdout:(12/13): python3-oauthlib-2.1.0-1.el8.noarch.rp 2.5 MB/s | 155 kB 00:00 2023-01-25T06:15:59.669 INFO:teuthology.orchestra.run.smithi088.stdout:(13/13): python3-requests-oauthlib-1.0.0-1.el8. 639 kB/s | 43 kB 00:00 2023-01-25T06:15:59.670 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:15:59.670 INFO:teuthology.orchestra.run.smithi088.stdout:Total 3.4 MB/s | 1.9 MB 00:00 2023-01-25T06:15:59.715 INFO:teuthology.orchestra.run.smithi089.stdout:Installed products updated. 2023-01-25T06:15:59.726 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T06:15:59.741 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T06:15:59.742 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T06:15:59.812 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T06:15:59.815 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T06:15:59.898 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:15:59.899 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T06:15:59.899 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:15:59.899 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-01-25T06:15:59.899 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-01-25T06:15:59.900 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-0.3.15-3.el8.x86_64 2023-01-25T06:15:59.900 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-01-25T06:15:59.900 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-01-25T06:15:59.900 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-01-25T06:15:59.900 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-01-25T06:15:59.901 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:15:59.901 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T06:16:00.033 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-rook 2023-01-25T06:16:00.299 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T06:16:00.378 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:16:00.494 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-01-25T06:16:00.738 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rsa-4.8-1.el8.noarch 2/13 2023-01-25T06:16:00.946 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/13 2023-01-25T06:16:01.131 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 4/13 2023-01-25T06:16:01.185 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:02:27 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:16:01.276 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 5/13 2023-01-25T06:16:01.443 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 6/13 2023-01-25T06:16:01.614 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 7/13 2023-01-25T06:16:01.777 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 8/13 2023-01-25T06:16:01.967 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-01-25T06:16:02.157 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 10/13 2023-01-25T06:16:02.585 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T06:16:02.587 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================================== 2023-01-25T06:16:02.587 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-01-25T06:16:02.587 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================================== 2023-01-25T06:16:02.588 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T06:16:02.588 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 47 k 2023-01-25T06:16:02.588 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-01-25T06:16:02.588 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-01-25T06:16:02.588 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-01-25T06:16:02.589 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-01-25T06:16:02.589 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-01-25T06:16:02.589 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-01-25T06:16:02.589 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-01-25T06:16:02.589 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-01-25T06:16:02.590 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-01-25T06:16:02.590 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-01-25T06:16:02.590 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-01-25T06:16:02.590 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-01-25T06:16:02.590 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-01-25T06:16:02.591 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:16:02.591 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T06:16:02.591 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================================== 2023-01-25T06:16:02.591 INFO:teuthology.orchestra.run.smithi089.stdout:Install 13 Packages 2023-01-25T06:16:02.591 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:16:02.592 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 1.9 M 2023-01-25T06:16:02.592 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 25 M 2023-01-25T06:16:02.592 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T06:16:02.715 INFO:teuthology.orchestra.run.smithi089.stdout:(1/13): python3-certifi-2018.10.15-7.el8.noarch 131 kB/s | 16 kB 00:00 2023-01-25T06:16:02.739 INFO:teuthology.orchestra.run.smithi089.stdout:(2/13): python3-cachetools-3.1.1-4.el8.noarch.r 221 kB/s | 33 kB 00:00 2023-01-25T06:16:02.807 INFO:teuthology.orchestra.run.smithi089.stdout:(3/13): ceph-mgr-rook-18.0.0-1963.g61996d73.el8 219 kB/s | 47 kB 00:00 2023-01-25T06:16:02.840 INFO:teuthology.orchestra.run.smithi089.stdout:(4/13): python3-google-auth-1.1.1-10.el8.noarch 648 kB/s | 81 kB 00:00 2023-01-25T06:16:02.899 INFO:teuthology.orchestra.run.smithi089.stdout:(5/13): python3-websocket-client-0.56.0-5.el8.n 1.0 MB/s | 61 kB 00:00 2023-01-25T06:16:02.949 INFO:teuthology.orchestra.run.smithi089.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 3.0 MB/s | 155 kB 00:00 2023-01-25T06:16:02.974 INFO:teuthology.orchestra.run.smithi089.stdout:(7/13): python3-rsa-4.8-1.el8.noarch.rpm 367 kB/s | 61 kB 00:00 2023-01-25T06:16:03.000 INFO:teuthology.orchestra.run.smithi089.stdout:(8/13): python3-requests-oauthlib-1.0.0-1.el8.n 849 kB/s | 43 kB 00:00 2023-01-25T06:16:03.070 INFO:teuthology.orchestra.run.smithi089.stdout:(9/13): python3-kubernetes-11.0.0-6.el8.noarch. 3.5 MB/s | 1.2 MB 00:00 2023-01-25T06:16:03.101 INFO:teuthology.orchestra.run.smithi089.stdout:(10/13): python3-jsonpatch-1.21-2.el8.noarch.rp 279 kB/s | 27 kB 00:00 2023-01-25T06:16:03.134 INFO:teuthology.orchestra.run.smithi089.stdout:(11/13): python3-pyasn1-modules-0.3.7-6.el8.noa 690 kB/s | 110 kB 00:00 2023-01-25T06:16:03.159 INFO:teuthology.orchestra.run.smithi089.stdout:(12/13): python3-jsonpointer-1.10-11.el8.noarch 378 kB/s | 20 kB 00:00 2023-01-25T06:16:03.184 INFO:teuthology.orchestra.run.smithi089.stdout:(13/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-01-25T06:16:03.185 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:16:03.185 INFO:teuthology.orchestra.run.smithi089.stdout:Total 3.2 MB/s | 1.9 MB 00:00 2023-01-25T06:16:03.215 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 11/13 2023-01-25T06:16:03.243 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T06:16:03.258 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T06:16:03.258 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T06:16:03.330 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T06:16:03.334 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T06:16:03.419 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 12/13 2023-01-25T06:16:03.594 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 13/13 2023-01-25T06:16:03.811 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T06:16:03.854 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 13/13 2023-01-25T06:16:03.854 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 1/13 2023-01-25T06:16:03.854 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 2/13 2023-01-25T06:16:03.854 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 3/13 2023-01-25T06:16:03.855 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 4/13 2023-01-25T06:16:03.855 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 5/13 2023-01-25T06:16:03.855 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 6/13 2023-01-25T06:16:03.855 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 7/13 2023-01-25T06:16:03.855 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 8/13 2023-01-25T06:16:03.856 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 9/13 2023-01-25T06:16:03.856 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 10/13 2023-01-25T06:16:03.856 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-01-25T06:16:03.856 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 12/13 2023-01-25T06:16:04.102 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-01-25T06:16:04.354 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rsa-4.8-1.el8.noarch 2/13 2023-01-25T06:16:04.525 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/13 2023-01-25T06:16:04.667 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 4/13 2023-01-25T06:16:04.864 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 5/13 2023-01-25T06:16:04.929 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 13/13 2023-01-25T06:16:04.929 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:30 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:16:05.073 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-01-25T06:16:05.288 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-01-25T06:16:05.508 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 8/13 2023-01-25T06:16:05.674 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-01-25T06:16:05.873 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 10/13 2023-01-25T06:16:06.945 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 11/13 2023-01-25T06:16:07.176 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 12/13 2023-01-25T06:16:07.326 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 13/13 2023-01-25T06:16:07.566 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 13/13 2023-01-25T06:16:07.566 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 1/13 2023-01-25T06:16:07.567 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 2/13 2023-01-25T06:16:07.567 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 3/13 2023-01-25T06:16:07.567 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 4/13 2023-01-25T06:16:07.567 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 5/13 2023-01-25T06:16:07.567 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 6/13 2023-01-25T06:16:07.568 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 7/13 2023-01-25T06:16:07.568 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-01-25T06:16:07.568 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-01-25T06:16:07.568 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 10/13 2023-01-25T06:16:07.568 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 11/13 2023-01-25T06:16:07.569 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 12/13 2023-01-25T06:16:07.711 INFO:teuthology.orchestra.run.smithi088.stdout:Installed products updated. 2023-01-25T06:16:07.893 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:16:07.893 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T06:16:07.893 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:16:07.893 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-01-25T06:16:07.894 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-01-25T06:16:07.894 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-01-25T06:16:07.894 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-01-25T06:16:07.894 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-01-25T06:16:07.894 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-01-25T06:16:07.895 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-01-25T06:16:07.895 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-01-25T06:16:07.895 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-01-25T06:16:07.895 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-01-25T06:16:07.896 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa-4.8-1.el8.noarch 2023-01-25T06:16:07.896 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-01-25T06:16:07.896 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:16:07.897 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T06:16:08.020 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-mgr-cephadm 2023-01-25T06:16:08.372 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:16:08.654 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 13/13 2023-01-25T06:16:08.654 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:02:34 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:16:09.225 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:35 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:16:10.703 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T06:16:10.704 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================================== 2023-01-25T06:16:10.704 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-01-25T06:16:10.704 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================================== 2023-01-25T06:16:10.704 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T06:16:10.705 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 120 k 2023-01-25T06:16:10.705 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-01-25T06:16:10.705 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-01-25T06:16:10.705 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-01-25T06:16:10.706 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-01-25T06:16:10.706 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-01-25T06:16:10.706 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:16:10.706 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T06:16:10.706 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================================== 2023-01-25T06:16:10.707 INFO:teuthology.orchestra.run.smithi088.stdout:Install 5 Packages 2023-01-25T06:16:10.707 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:16:10.707 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 6.0 M 2023-01-25T06:16:10.708 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 26 M 2023-01-25T06:16:10.708 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T06:16:11.253 INFO:teuthology.orchestra.run.smithi089.stdout:Installed products updated. 2023-01-25T06:16:11.435 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:16:11.435 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T06:16:11.435 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:16:11.435 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-01-25T06:16:11.436 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-01-25T06:16:11.436 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-01-25T06:16:11.436 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-01-25T06:16:11.436 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-01-25T06:16:11.436 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-01-25T06:16:11.437 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-01-25T06:16:11.437 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-01-25T06:16:11.437 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-01-25T06:16:11.437 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-01-25T06:16:11.437 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa-4.8-1.el8.noarch 2023-01-25T06:16:11.438 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-01-25T06:16:11.438 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:16:11.438 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T06:16:11.572 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-cephadm 2023-01-25T06:16:11.852 INFO:teuthology.orchestra.run.smithi088.stdout:(1/5): ceph-mgr-cephadm-18.0.0-1963.g61996d73.e 105 kB/s | 120 kB 00:01 2023-01-25T06:16:11.919 INFO:teuthology.orchestra.run.smithi088.stdout:(2/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 7.9 MB/s | 538 kB 00:00 2023-01-25T06:16:11.921 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:16:12.053 INFO:teuthology.orchestra.run.smithi088.stdout:(3/5): python3-babel-2.5.1-7.el8.noarch.rpm 36 MB/s | 4.8 MB 00:00 2023-01-25T06:16:12.748 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:02:38 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:16:14.127 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T06:16:14.128 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================================== 2023-01-25T06:16:14.129 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-01-25T06:16:14.129 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================================== 2023-01-25T06:16:14.129 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T06:16:14.129 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 120 k 2023-01-25T06:16:14.129 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-01-25T06:16:14.130 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-01-25T06:16:14.130 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-01-25T06:16:14.130 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-01-25T06:16:14.130 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-01-25T06:16:14.130 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:16:14.130 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T06:16:14.131 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================================== 2023-01-25T06:16:14.131 INFO:teuthology.orchestra.run.smithi089.stdout:Install 5 Packages 2023-01-25T06:16:14.131 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:16:14.132 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 6.0 M 2023-01-25T06:16:14.132 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 26 M 2023-01-25T06:16:14.132 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T06:16:14.161 INFO:teuthology.orchestra.run.smithi088.stdout:(4/5): python3-natsort-7.1.1-2.el8.noarch.rpm 17 kB/s | 60 kB 00:03 2023-01-25T06:16:14.261 INFO:teuthology.orchestra.run.smithi088.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 134 kB/s | 476 kB 00:03 2023-01-25T06:16:14.263 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:16:14.263 INFO:teuthology.orchestra.run.smithi088.stdout:Total 1.7 MB/s | 6.0 MB 00:03 2023-01-25T06:16:14.292 INFO:teuthology.orchestra.run.smithi089.stdout:(1/5): python3-natsort-7.1.1-2.el8.noarch.rpm 373 kB/s | 60 kB 00:00 2023-01-25T06:16:14.320 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T06:16:14.332 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T06:16:14.332 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T06:16:14.359 INFO:teuthology.orchestra.run.smithi089.stdout:(2/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 7.9 MB/s | 538 kB 00:00 2023-01-25T06:16:14.411 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T06:16:14.415 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T06:16:14.426 INFO:teuthology.orchestra.run.smithi089.stdout:(3/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.6 MB/s | 476 kB 00:00 2023-01-25T06:16:14.502 INFO:teuthology.orchestra.run.smithi089.stdout:(4/5): python3-babel-2.5.1-7.el8.noarch.rpm 34 MB/s | 4.8 MB 00:00 2023-01-25T06:16:14.677 INFO:teuthology.orchestra.run.smithi089.stdout:(5/5): ceph-mgr-cephadm-18.0.0-1963.g61996d73.e 220 kB/s | 120 kB 00:00 2023-01-25T06:16:14.678 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:16:14.678 INFO:teuthology.orchestra.run.smithi089.stdout:Total 11 MB/s | 6.0 MB 00:00 2023-01-25T06:16:14.731 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T06:16:14.742 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T06:16:14.742 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T06:16:14.820 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T06:16:14.824 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T06:16:15.427 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T06:16:15.760 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 1/5 2023-01-25T06:16:15.790 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T06:16:16.001 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 2/5 2023-01-25T06:16:16.137 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 1/5 2023-01-25T06:16:16.296 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 3/5 2023-01-25T06:16:16.360 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 2/5 2023-01-25T06:16:16.569 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-01-25T06:16:16.705 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 3/5 2023-01-25T06:16:16.758 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 5/5 2023-01-25T06:16:16.961 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-01-25T06:16:16.997 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 5/5 2023-01-25T06:16:16.997 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/5 2023-01-25T06:16:16.997 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-01-25T06:16:16.998 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 3/5 2023-01-25T06:16:16.998 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-01-25T06:16:17.150 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 5/5 2023-01-25T06:16:17.387 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 5/5 2023-01-25T06:16:17.387 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/5 2023-01-25T06:16:17.387 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-01-25T06:16:17.387 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 3/5 2023-01-25T06:16:17.387 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-01-25T06:16:18.026 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 5/5 2023-01-25T06:16:18.026 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:44 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:16:18.399 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 5/5 2023-01-25T06:16:18.400 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:02:44 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:16:21.056 INFO:teuthology.orchestra.run.smithi088.stdout:Installed products updated. 2023-01-25T06:16:21.200 INFO:teuthology.orchestra.run.smithi089.stdout:Installed products updated. 2023-01-25T06:16:21.242 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:16:21.243 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T06:16:21.243 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:16:21.243 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-01-25T06:16:21.243 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel-2.5.1-7.el8.noarch 2023-01-25T06:16:21.243 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-01-25T06:16:21.244 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-01-25T06:16:21.244 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:16:21.244 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T06:16:21.357 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-fuse 2023-01-25T06:16:21.382 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:16:21.382 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T06:16:21.383 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:16:21.383 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-01-25T06:16:21.383 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel-2.5.1-7.el8.noarch 2023-01-25T06:16:21.383 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-01-25T06:16:21.383 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-01-25T06:16:21.384 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:16:21.384 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T06:16:21.505 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-fuse 2023-01-25T06:16:21.709 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:16:21.856 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:16:22.535 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:48 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:16:22.704 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:02:48 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:16:23.908 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T06:16:23.908 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T06:16:23.908 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-01-25T06:16:23.909 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T06:16:23.909 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T06:16:23.909 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse 2023-01-25T06:16:23.909 INFO:teuthology.orchestra.run.smithi088.stdout: x86_64 2:18.0.0-1963.g61996d73.el8 ceph 845 k 2023-01-25T06:16:23.909 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-01-25T06:16:23.910 INFO:teuthology.orchestra.run.smithi088.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-01-25T06:16:23.910 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:16:23.910 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T06:16:23.910 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T06:16:23.910 INFO:teuthology.orchestra.run.smithi088.stdout:Install 2 Packages 2023-01-25T06:16:23.911 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:16:23.911 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 928 k 2023-01-25T06:16:23.912 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 2.9 M 2023-01-25T06:16:23.912 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T06:16:23.971 INFO:teuthology.orchestra.run.smithi088.stdout:(1/2): fuse-2.9.7-15.el8.x86_64.rpm 1.3 MB/s | 83 kB 00:00 2023-01-25T06:16:24.126 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T06:16:24.127 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T06:16:24.127 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-01-25T06:16:24.127 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T06:16:24.127 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T06:16:24.128 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse 2023-01-25T06:16:24.128 INFO:teuthology.orchestra.run.smithi089.stdout: x86_64 2:18.0.0-1963.g61996d73.el8 ceph 845 k 2023-01-25T06:16:24.128 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-01-25T06:16:24.128 INFO:teuthology.orchestra.run.smithi089.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-01-25T06:16:24.128 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:16:24.129 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T06:16:24.129 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T06:16:24.129 INFO:teuthology.orchestra.run.smithi089.stdout:Install 2 Packages 2023-01-25T06:16:24.129 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:16:24.130 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 928 k 2023-01-25T06:16:24.130 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 2.9 M 2023-01-25T06:16:24.130 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T06:16:24.184 INFO:teuthology.orchestra.run.smithi089.stdout:(1/2): fuse-2.9.7-15.el8.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2023-01-25T06:16:24.660 INFO:teuthology.orchestra.run.smithi089.stdout:(2/2): ceph-fuse-18.0.0-1963.g61996d73.el8.x86_ 1.6 MB/s | 845 kB 00:00 2023-01-25T06:16:24.660 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:16:24.661 INFO:teuthology.orchestra.run.smithi089.stdout:Total 1.7 MB/s | 928 kB 00:00 2023-01-25T06:16:24.672 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T06:16:24.693 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T06:16:24.693 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T06:16:24.721 INFO:teuthology.orchestra.run.smithi088.stdout:(2/2): ceph-fuse-18.0.0-1963.g61996d73.el8.x86_ 1.0 MB/s | 845 kB 00:00 2023-01-25T06:16:24.722 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:16:24.722 INFO:teuthology.orchestra.run.smithi088.stdout:Total 1.1 MB/s | 928 kB 00:00 2023-01-25T06:16:24.734 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T06:16:24.756 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T06:16:24.757 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T06:16:24.766 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T06:16:24.769 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T06:16:24.830 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T06:16:24.834 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T06:16:25.002 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T06:16:25.211 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T06:16:25.238 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : fuse-2.9.7-15.el8.x86_64 1/2 2023-01-25T06:16:26.055 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 2/2 2023-01-25T06:16:26.274 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fuse-2.9.7-15.el8.x86_64 1/2 2023-01-25T06:16:26.404 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 2/2 2023-01-25T06:16:26.404 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/2 2023-01-25T06:16:27.222 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 2/2 2023-01-25T06:16:27.453 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 2/2 2023-01-25T06:16:27.454 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:53 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:16:27.556 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 2/2 2023-01-25T06:16:27.556 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/2 2023-01-25T06:16:28.607 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 2/2 2023-01-25T06:16:28.607 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:02:54 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:16:30.410 INFO:teuthology.orchestra.run.smithi088.stdout:Installed products updated. 2023-01-25T06:16:30.591 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:16:30.591 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T06:16:30.591 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 fuse-2.9.7-15.el8.x86_64 2023-01-25T06:16:30.592 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:16:30.592 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T06:16:30.709 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-volume 2023-01-25T06:16:31.065 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:16:31.405 INFO:teuthology.orchestra.run.smithi089.stdout:Installed products updated. 2023-01-25T06:16:31.584 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:16:31.585 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T06:16:31.585 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 fuse-2.9.7-15.el8.x86_64 2023-01-25T06:16:31.585 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:16:31.585 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T06:16:31.707 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-volume 2023-01-25T06:16:32.023 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:58 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:16:32.059 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:16:33.042 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:02:59 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:16:33.484 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T06:16:33.485 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T06:16:33.485 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-01-25T06:16:33.485 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T06:16:33.486 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T06:16:33.486 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-volume noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 263 k 2023-01-25T06:16:33.486 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:16:33.486 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T06:16:33.486 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T06:16:33.487 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-01-25T06:16:33.487 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:16:33.487 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 263 k 2023-01-25T06:16:33.487 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 1.3 M 2023-01-25T06:16:33.487 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T06:16:34.034 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-volume-18.0.0-1963.g61996d73.el8.noarch.rp 480 kB/s | 263 kB 00:00 2023-01-25T06:16:34.035 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:16:34.035 INFO:teuthology.orchestra.run.smithi088.stdout:Total 479 kB/s | 263 kB 00:00 2023-01-25T06:16:34.036 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T06:16:34.045 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T06:16:34.045 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T06:16:34.062 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T06:16:34.066 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T06:16:34.233 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T06:16:34.412 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T06:16:34.413 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T06:16:34.413 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-01-25T06:16:34.413 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T06:16:34.414 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T06:16:34.414 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 263 k 2023-01-25T06:16:34.414 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:16:34.414 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T06:16:34.414 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T06:16:34.415 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2023-01-25T06:16:34.415 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:16:34.415 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 263 k 2023-01-25T06:16:34.415 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 1.3 M 2023-01-25T06:16:34.415 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T06:16:34.488 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:16:34.837 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:16:34.917 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-volume-18.0.0-1963.g61996d73.el8.noarch.rp 522 kB/s | 263 kB 00:00 2023-01-25T06:16:34.918 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:16:34.919 INFO:teuthology.orchestra.run.smithi089.stdout:Total 520 kB/s | 263 kB 00:00 2023-01-25T06:16:34.919 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T06:16:34.929 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T06:16:34.929 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T06:16:34.947 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T06:16:34.951 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T06:16:35.114 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T06:16:35.364 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:16:35.713 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:16:35.866 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:16:35.867 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:03:01 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:16:36.753 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:16:36.754 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:02 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:16:38.671 INFO:teuthology.orchestra.run.smithi088.stdout:Installed products updated. 2023-01-25T06:16:38.851 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:16:38.851 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T06:16:38.851 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:16:38.852 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:16:38.852 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T06:16:38.984 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install librados-devel 2023-01-25T06:16:39.340 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:16:39.430 INFO:teuthology.orchestra.run.smithi089.stdout:Installed products updated. 2023-01-25T06:16:39.610 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:16:39.611 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T06:16:39.611 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:16:39.611 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:16:39.611 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T06:16:39.743 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install librados-devel 2023-01-25T06:16:40.099 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:16:40.207 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:03:06 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:16:41.003 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:07 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:16:41.582 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T06:16:41.583 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T06:16:41.583 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repo Size 2023-01-25T06:16:41.583 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T06:16:41.583 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T06:16:41.583 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel x86_64 2:18.0.0-1963.g61996d73.el8 ceph 139 k 2023-01-25T06:16:41.584 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:16:41.584 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T06:16:41.584 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T06:16:41.584 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-01-25T06:16:41.584 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:16:41.585 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 139 k 2023-01-25T06:16:41.585 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 512 k 2023-01-25T06:16:41.585 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T06:16:41.990 INFO:teuthology.orchestra.run.smithi088.stdout:librados-devel-18.0.0-1963.g61996d73.el8.x86_64 342 kB/s | 139 kB 00:00 2023-01-25T06:16:41.990 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:16:41.991 INFO:teuthology.orchestra.run.smithi088.stdout:Total 341 kB/s | 139 kB 00:00 2023-01-25T06:16:41.991 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T06:16:41.996 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T06:16:41.996 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T06:16:42.049 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T06:16:42.053 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T06:16:42.172 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T06:16:42.316 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:16:42.376 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T06:16:42.376 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T06:16:42.377 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2023-01-25T06:16:42.377 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T06:16:42.377 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T06:16:42.377 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel x86_64 2:18.0.0-1963.g61996d73.el8 ceph 139 k 2023-01-25T06:16:42.378 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:16:42.378 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T06:16:42.378 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T06:16:42.378 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2023-01-25T06:16:42.378 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:16:42.379 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 139 k 2023-01-25T06:16:42.379 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 512 k 2023-01-25T06:16:42.379 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T06:16:42.533 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:16:42.792 INFO:teuthology.orchestra.run.smithi089.stdout:librados-devel-18.0.0-1963.g61996d73.el8.x86_64 335 kB/s | 139 kB 00:00 2023-01-25T06:16:42.793 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:16:42.793 INFO:teuthology.orchestra.run.smithi089.stdout:Total 334 kB/s | 139 kB 00:00 2023-01-25T06:16:42.793 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T06:16:42.798 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T06:16:42.798 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T06:16:42.851 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T06:16:42.855 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T06:16:42.984 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T06:16:43.152 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:16:43.387 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:16:43.572 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:16:43.572 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:03:09 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:16:44.410 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:16:44.410 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:10 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:16:46.522 INFO:teuthology.orchestra.run.smithi088.stdout:Installed products updated. 2023-01-25T06:16:46.700 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:16:46.700 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T06:16:46.700 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:16:46.701 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:16:46.701 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T06:16:46.843 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install libcephfs2 2023-01-25T06:16:47.173 INFO:teuthology.orchestra.run.smithi089.stdout:Installed products updated. 2023-01-25T06:16:47.196 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:16:47.354 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:16:47.354 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T06:16:47.354 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:16:47.355 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:16:47.355 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T06:16:47.483 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install libcephfs2 2023-01-25T06:16:47.837 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:16:48.150 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:03:14 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:16:48.686 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:14 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:16:49.496 INFO:teuthology.orchestra.run.smithi088.stdout:Package libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:16:49.604 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T06:16:49.605 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-01-25T06:16:49.605 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T06:16:49.725 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install libcephfs-devel 2023-01-25T06:16:49.947 INFO:teuthology.orchestra.run.smithi089.stdout:Package libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:16:50.054 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T06:16:50.056 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-01-25T06:16:50.056 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T06:16:50.080 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:16:50.170 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install libcephfs-devel 2023-01-25T06:16:50.523 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:16:50.982 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:03:16 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:16:51.459 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:17 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:16:52.363 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T06:16:52.364 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T06:16:52.365 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repo Size 2023-01-25T06:16:52.365 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T06:16:52.365 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T06:16:52.365 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel x86_64 2:18.0.0-1963.g61996d73.el8 ceph 30 k 2023-01-25T06:16:52.366 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:16:52.366 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T06:16:52.366 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T06:16:52.366 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-01-25T06:16:52.366 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:16:52.366 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 30 k 2023-01-25T06:16:52.367 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 137 k 2023-01-25T06:16:52.367 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T06:16:52.593 INFO:teuthology.orchestra.run.smithi088.stdout:libcephfs-devel-18.0.0-1963.g61996d73.el8.x86_6 134 kB/s | 30 kB 00:00 2023-01-25T06:16:52.594 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:16:52.594 INFO:teuthology.orchestra.run.smithi088.stdout:Total 133 kB/s | 30 kB 00:00 2023-01-25T06:16:52.594 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T06:16:52.598 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T06:16:52.598 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T06:16:52.608 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T06:16:52.612 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T06:16:52.696 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T06:16:52.846 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T06:16:52.848 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T06:16:52.848 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2023-01-25T06:16:52.848 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T06:16:52.849 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T06:16:52.849 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel x86_64 2:18.0.0-1963.g61996d73.el8 ceph 30 k 2023-01-25T06:16:52.850 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:16:52.850 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T06:16:52.850 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T06:16:52.851 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2023-01-25T06:16:52.851 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:16:52.851 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 30 k 2023-01-25T06:16:52.852 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 137 k 2023-01-25T06:16:52.853 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T06:16:52.888 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:16:53.073 INFO:teuthology.orchestra.run.smithi089.stdout:libcephfs-devel-18.0.0-1963.g61996d73.el8.x86_6 135 kB/s | 30 kB 00:00 2023-01-25T06:16:53.074 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:16:53.074 INFO:teuthology.orchestra.run.smithi089.stdout:Total 134 kB/s | 30 kB 00:00 2023-01-25T06:16:53.074 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T06:16:53.078 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T06:16:53.078 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T06:16:53.088 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T06:16:53.092 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T06:16:53.103 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:16:53.170 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T06:16:53.358 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:16:53.577 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:16:54.092 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:16:54.093 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:03:20 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:16:54.574 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:16:54.575 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:20 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:16:56.677 INFO:teuthology.orchestra.run.smithi088.stdout:Installed products updated. 2023-01-25T06:16:56.854 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:16:56.855 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T06:16:56.855 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:16:56.855 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:16:56.855 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T06:16:56.984 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install librados2 2023-01-25T06:16:57.158 INFO:teuthology.orchestra.run.smithi089.stdout:Installed products updated. 2023-01-25T06:16:57.337 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:16:57.337 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:16:57.338 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T06:16:57.338 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:16:57.338 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:16:57.338 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T06:16:57.475 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install librados2 2023-01-25T06:16:57.829 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:16:58.230 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:03:24 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:16:58.724 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:24 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:16:59.503 INFO:teuthology.orchestra.run.smithi088.stdout:Package librados2-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:16:59.608 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T06:16:59.609 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-01-25T06:16:59.609 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T06:16:59.731 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install librbd1 2023-01-25T06:17:00.013 INFO:teuthology.orchestra.run.smithi089.stdout:Package librados2-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:17:00.083 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:17:00.120 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T06:17:00.121 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-01-25T06:17:00.121 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T06:17:00.224 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install librbd1 2023-01-25T06:17:00.577 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:17:00.895 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:03:26 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:17:01.370 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:27 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:17:02.178 INFO:teuthology.orchestra.run.smithi088.stdout:Package librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:17:02.286 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T06:17:02.289 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-01-25T06:17:02.289 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T06:17:02.404 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install python3-rados 2023-01-25T06:17:02.642 INFO:teuthology.orchestra.run.smithi089.stdout:Package librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:17:02.747 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T06:17:02.748 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-01-25T06:17:02.749 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T06:17:02.759 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:17:02.850 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-rados 2023-01-25T06:17:03.201 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:17:03.564 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:03:29 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:17:03.985 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:29 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:17:04.839 INFO:teuthology.orchestra.run.smithi088.stdout:Package python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:17:04.945 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T06:17:04.947 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-01-25T06:17:04.947 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T06:17:05.053 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install python3-rgw 2023-01-25T06:17:05.277 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:17:05.383 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T06:17:05.384 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-01-25T06:17:05.385 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T06:17:05.405 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:17:05.519 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-rgw 2023-01-25T06:17:05.871 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:17:06.212 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:03:32 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:17:06.663 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:32 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:17:07.516 INFO:teuthology.orchestra.run.smithi088.stdout:Package python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:17:07.625 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T06:17:07.626 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-01-25T06:17:07.626 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T06:17:07.747 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install python3-cephfs 2023-01-25T06:17:08.013 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:17:08.100 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:17:08.120 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T06:17:08.121 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-01-25T06:17:08.121 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T06:17:08.223 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-cephfs 2023-01-25T06:17:08.574 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:17:08.897 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:03:34 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:17:09.389 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:35 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:17:10.218 INFO:teuthology.orchestra.run.smithi088.stdout:Package python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:17:10.324 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T06:17:10.325 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-01-25T06:17:10.325 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T06:17:10.426 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install python3-rbd 2023-01-25T06:17:10.669 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:17:10.775 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T06:17:10.776 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-01-25T06:17:10.776 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T06:17:10.778 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:17:10.891 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-rbd 2023-01-25T06:17:11.243 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:17:11.561 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:03:37 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:17:12.069 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:38 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:17:12.911 INFO:teuthology.orchestra.run.smithi088.stdout:Package python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:17:13.018 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T06:17:13.019 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-01-25T06:17:13.019 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T06:17:13.125 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install rbd-fuse 2023-01-25T06:17:13.419 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:17:13.478 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:17:13.525 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T06:17:13.526 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-01-25T06:17:13.526 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T06:17:13.634 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install rbd-fuse 2023-01-25T06:17:13.987 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:17:14.333 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:03:40 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:17:14.851 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:40 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:17:15.702 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T06:17:15.703 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T06:17:15.703 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2023-01-25T06:17:15.704 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T06:17:15.704 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T06:17:15.704 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse x86_64 2:18.0.0-1963.g61996d73.el8 ceph 94 k 2023-01-25T06:17:15.704 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:15.705 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T06:17:15.705 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T06:17:15.705 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-01-25T06:17:15.705 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:15.705 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 94 k 2023-01-25T06:17:15.706 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 280 k 2023-01-25T06:17:15.706 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T06:17:15.918 INFO:teuthology.orchestra.run.smithi088.stdout:rbd-fuse-18.0.0-1963.g61996d73.el8.x86_64.rpm 440 kB/s | 94 kB 00:00 2023-01-25T06:17:15.919 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:17:15.919 INFO:teuthology.orchestra.run.smithi088.stdout:Total 438 kB/s | 94 kB 00:00 2023-01-25T06:17:15.920 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T06:17:15.930 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T06:17:15.930 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T06:17:15.984 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T06:17:15.988 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T06:17:16.099 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T06:17:16.237 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T06:17:16.238 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T06:17:16.238 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2023-01-25T06:17:16.239 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T06:17:16.239 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T06:17:16.239 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse x86_64 2:18.0.0-1963.g61996d73.el8 ceph 94 k 2023-01-25T06:17:16.239 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:16.239 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T06:17:16.239 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T06:17:16.240 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2023-01-25T06:17:16.240 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:16.240 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 94 k 2023-01-25T06:17:16.241 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 280 k 2023-01-25T06:17:16.241 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T06:17:16.242 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:17:16.442 INFO:teuthology.orchestra.run.smithi089.stdout:rbd-fuse-18.0.0-1963.g61996d73.el8.x86_64.rpm 465 kB/s | 94 kB 00:00 2023-01-25T06:17:16.443 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:17:16.444 INFO:teuthology.orchestra.run.smithi089.stdout:Total 462 kB/s | 94 kB 00:00 2023-01-25T06:17:16.444 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T06:17:16.454 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T06:17:16.454 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T06:17:16.470 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:17:16.506 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T06:17:16.510 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T06:17:16.616 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T06:17:16.772 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:17:17.019 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:17:17.484 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:17:17.484 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:03:43 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:17:18.059 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:17:18.059 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:44 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:17:19.937 INFO:teuthology.orchestra.run.smithi088.stdout:Installed products updated. 2023-01-25T06:17:20.115 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:20.115 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T06:17:20.116 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:17:20.116 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:20.116 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T06:17:20.280 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install rbd-mirror 2023-01-25T06:17:20.632 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:17:20.694 INFO:teuthology.orchestra.run.smithi089.stdout:Installed products updated. 2023-01-25T06:17:20.871 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:20.872 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T06:17:20.872 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:17:20.872 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:20.872 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T06:17:21.002 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install rbd-mirror 2023-01-25T06:17:21.356 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:17:21.493 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:03:47 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:17:22.157 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:48 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:17:22.940 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T06:17:22.941 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T06:17:22.942 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repo Size 2023-01-25T06:17:22.942 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T06:17:22.942 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T06:17:22.942 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.4 M 2023-01-25T06:17:22.942 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:22.943 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T06:17:22.943 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T06:17:22.943 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-01-25T06:17:22.943 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:22.943 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 3.4 M 2023-01-25T06:17:22.944 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 16 M 2023-01-25T06:17:22.944 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T06:17:23.429 INFO:teuthology.orchestra.run.smithi088.stdout:rbd-mirror-18.0.0-1963.g61996d73.el8.x86_64.rpm 7.1 MB/s | 3.4 MB 00:00 2023-01-25T06:17:23.429 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:17:23.430 INFO:teuthology.orchestra.run.smithi088.stdout:Total 7.1 MB/s | 3.4 MB 00:00 2023-01-25T06:17:23.430 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T06:17:23.442 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T06:17:23.442 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T06:17:23.509 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T06:17:23.513 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T06:17:23.535 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T06:17:23.536 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T06:17:23.536 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2023-01-25T06:17:23.536 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T06:17:23.536 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T06:17:23.537 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.4 M 2023-01-25T06:17:23.537 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:23.537 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T06:17:23.537 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T06:17:23.537 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2023-01-25T06:17:23.538 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:23.538 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 3.4 M 2023-01-25T06:17:23.538 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 16 M 2023-01-25T06:17:23.538 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T06:17:23.978 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T06:17:24.087 INFO:teuthology.orchestra.run.smithi089.stdout:rbd-mirror-18.0.0-1963.g61996d73.el8.x86_64.rpm 6.3 MB/s | 3.4 MB 00:00 2023-01-25T06:17:24.088 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:17:24.088 INFO:teuthology.orchestra.run.smithi089.stdout:Total 6.3 MB/s | 3.4 MB 00:00 2023-01-25T06:17:24.088 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T06:17:24.100 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T06:17:24.101 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T06:17:24.143 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:17:24.165 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T06:17:24.169 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T06:17:24.497 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:17:24.612 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T06:17:24.790 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:17:25.156 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:17:25.519 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:17:25.520 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:03:51 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:17:26.163 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:17:26.163 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:52 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:17:28.073 INFO:teuthology.orchestra.run.smithi088.stdout:Installed products updated. 2023-01-25T06:17:28.257 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:28.257 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T06:17:28.258 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:17:28.258 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:28.258 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T06:17:28.384 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install rbd-nbd 2023-01-25T06:17:28.739 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-01-25T06:17:29.193 INFO:teuthology.orchestra.run.smithi089.stdout:Installed products updated. 2023-01-25T06:17:29.374 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:29.374 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T06:17:29.374 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:17:29.374 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:29.375 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T06:17:29.504 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install rbd-nbd 2023-01-25T06:17:29.656 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:03:55 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:17:29.860 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-01-25T06:17:30.652 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:56 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:17:31.032 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T06:17:31.033 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T06:17:31.033 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2023-01-25T06:17:31.033 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T06:17:31.034 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T06:17:31.034 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd x86_64 2:18.0.0-1963.g61996d73.el8 ceph 179 k 2023-01-25T06:17:31.034 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:31.034 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T06:17:31.034 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T06:17:31.035 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-01-25T06:17:31.035 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:31.036 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 179 k 2023-01-25T06:17:31.036 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 568 k 2023-01-25T06:17:31.036 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T06:17:31.231 INFO:teuthology.orchestra.run.smithi088.stdout:rbd-nbd-18.0.0-1963.g61996d73.el8.x86_64.rpm 914 kB/s | 179 kB 00:00 2023-01-25T06:17:31.232 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:17:31.232 INFO:teuthology.orchestra.run.smithi088.stdout:Total 909 kB/s | 179 kB 00:00 2023-01-25T06:17:31.232 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T06:17:31.245 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T06:17:31.245 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T06:17:31.297 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T06:17:31.300 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T06:17:31.413 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T06:17:31.555 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:17:31.782 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:17:32.105 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T06:17:32.106 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T06:17:32.106 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2023-01-25T06:17:32.106 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T06:17:32.106 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T06:17:32.107 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd x86_64 2:18.0.0-1963.g61996d73.el8 ceph 179 k 2023-01-25T06:17:32.107 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:32.107 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T06:17:32.107 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T06:17:32.107 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2023-01-25T06:17:32.107 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:32.108 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 179 k 2023-01-25T06:17:32.108 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 568 k 2023-01-25T06:17:32.108 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T06:17:32.307 INFO:teuthology.orchestra.run.smithi089.stdout:rbd-nbd-18.0.0-1963.g61996d73.el8.x86_64.rpm 897 kB/s | 179 kB 00:00 2023-01-25T06:17:32.307 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:17:32.308 INFO:teuthology.orchestra.run.smithi089.stdout:Total 892 kB/s | 179 kB 00:00 2023-01-25T06:17:32.308 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T06:17:32.319 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T06:17:32.319 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T06:17:32.373 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T06:17:32.377 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T06:17:32.499 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T06:17:32.669 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:17:32.816 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:17:32.816 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:03:58 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:17:32.901 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:17:33.954 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:17:33.954 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:59 ago on Wed 25 Jan 2023 06:13:34 AM UTC. 2023-01-25T06:17:35.114 INFO:teuthology.orchestra.run.smithi088.stdout:Installed products updated. 2023-01-25T06:17:35.295 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:35.295 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T06:17:35.296 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:17:35.296 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:35.296 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T06:17:35.422 DEBUG:teuthology.parallel:result is None 2023-01-25T06:17:36.579 INFO:teuthology.orchestra.run.smithi089.stdout:Installed products updated. 2023-01-25T06:17:36.755 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:36.755 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T06:17:36.756 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:17:36.756 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:36.756 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T06:17:36.883 DEBUG:teuthology.parallel:result is None 2023-01-25T06:17:36.884 DEBUG:teuthology.orchestra.run.smithi088:> sudo lsb_release -is 2023-01-25T06:17:36.935 INFO:teuthology.orchestra.run.smithi088.stdout:RedHatEnterprise 2023-01-25T06:17:36.936 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2023-01-25T06:17:36.937 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=61996d73ab738798e4ee0055c86457f5c459da4a 2023-01-25T06:17:37.097 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-01-25T06:17:37.122 INFO:teuthology.orchestra.run.smithi088.stdout:18.0.0-1963.g61996d73.el8 2023-01-25T06:17:37.123 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-1963.g61996d73.el8 2023-01-25T06:17:37.124 INFO:teuthology.task.install:The correct ceph version 18.0.0-1963.g61996d73 is installed. 2023-01-25T06:17:37.125 DEBUG:teuthology.orchestra.run.smithi089:> sudo lsb_release -is 2023-01-25T06:17:37.168 INFO:teuthology.orchestra.run.smithi089.stdout:RedHatEnterprise 2023-01-25T06:17:37.169 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2023-01-25T06:17:37.170 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=61996d73ab738798e4ee0055c86457f5c459da4a 2023-01-25T06:17:37.326 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-01-25T06:17:37.347 INFO:teuthology.orchestra.run.smithi089.stdout:18.0.0-1963.g61996d73.el8 2023-01-25T06:17:37.347 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-1963.g61996d73.el8 2023-01-25T06:17:37.348 INFO:teuthology.task.install:The correct ceph version 18.0.0-1963.g61996d73 is installed. 2023-01-25T06:17:37.348 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-01-25T06:17:37.348 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-01-25T06:17:37.349 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-25T06:17:37.381 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-01-25T06:17:37.381 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-25T06:17:37.414 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-01-25T06:17:37.415 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-01-25T06:17:37.415 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/daemon-helper 2023-01-25T06:17:37.451 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-25T06:17:37.520 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-01-25T06:17:37.521 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2023-01-25T06:17:37.548 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-25T06:17:37.614 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-01-25T06:17:37.614 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-01-25T06:17:37.614 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-25T06:17:37.643 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-25T06:17:37.711 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-01-25T06:17:37.712 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-25T06:17:37.739 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-25T06:17:37.806 INFO:teuthology.run_tasks:Running task ceph... 2023-01-25T06:17:37.869 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-01-25T06:17:37.870 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 777 /var/log/ceph 2023-01-25T06:17:37.873 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /var/log/ceph 2023-01-25T06:17:37.900 INFO:tasks.ceph:Disabling ceph logrotate... 2023-01-25T06:17:37.900 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/logrotate.d/ceph 2023-01-25T06:17:37.940 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/logrotate.d/ceph 2023-01-25T06:17:37.966 INFO:tasks.ceph:Creating extra log directories... 2023-01-25T06:17:37.967 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-01-25T06:17:38.007 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-01-25T06:17:38.046 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-01-25T06:17:38.046 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd backoff on degraded': True, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd inject bad map crc probability': 0.1, 'osd map cache size': 1, 'osd max backfills': 6, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'filestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub during recovery': False, 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd sloppy crc': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'global': {'mon election default strategy': 1, 'ms type': 'async', 'osd debug inject dispatch delay duration': 0.1, 'osd debug inject dispatch delay probability': 0.1, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', 'but it is still running', 'objects unfound and apparently lost', 'osd_map_cache_size', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'must scrub before tier agent can activate'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-01-25T06:17:38.047 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi/7136899', 'branch': 'wip-yuri2-testing-2023-01-23-0928', 'description': 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy}', 'email': 'yweinstein@radhat.com', 'first_in_suite': False, 'job_id': '7136899', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 30}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-yuri2-testing-2023-01-23-0928'}, 'ceph': {'conf': {'global': {'mon election default strategy': 1, 'ms type': 'async', 'osd debug inject dispatch delay duration': 0.1, 'osd debug inject dispatch delay probability': 0.1, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'osd': {'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd backoff on degraded': True, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd inject bad map crc probability': 0.1, 'osd map cache size': 1, 'osd max backfills': 6, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'filestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub during recovery': False, 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd sloppy crc': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', 'but it is still running', 'objects unfound and apparently lost', 'osd_map_cache_size', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'must scrub before tier agent can activate'], 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'osd objectstore': 'filestore', 'osd sloppy crc': True}}, 'filestore': True, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'workunit': {'branch': 'wip-yuri2-testing-2023-01-23-0928', 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 71, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a', 'sleep_before_teardown': 0, 'suite': 'rados', 'suite_branch': 'wip-yuri2-testing-2023-01-23-0928', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_61996d73ab738798e4ee0055c86457f5c459da4a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '61996d73ab738798e4ee0055c86457f5c459da4a', 'targets': {'smithi088.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi089.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd backoff on degraded': True, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd inject bad map crc probability': 0.1, 'osd map cache size': 1, 'osd max backfills': 6, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'filestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub during recovery': False, 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd sloppy crc': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'global': {'mon election default strategy': 1, 'ms type': 'async', 'osd debug inject dispatch delay duration': 0.1, 'osd debug inject dispatch delay probability': 0.1, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', 'but it is still running', 'objects unfound and apparently lost', 'osd_map_cache_size', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'must scrub before tier agent can activate'], 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a', 'cluster': 'ceph'}}, {'exec': {'mon.a': ['while ! ceph balancer status ; do sleep 1 ; done', 'ceph balancer mode crush-compat', 'ceph balancer on']}}, {'thrashosds': {'chance_pgnum_grow': 0.25, 'chance_pgnum_shrink': 0.25, 'chance_pgpnum_fix': 0.25, 'chance_test_map_discontinuity': 2, 'timeout': 1800}}, {'exec': {'client.0': ['sudo ceph osd pool create base 4', 'sudo ceph osd pool application enable base rados', 'sudo ceph osd pool create cache 4', 'sudo ceph osd tier add base cache', 'sudo ceph osd tier cache-mode cache readproxy', 'sudo ceph osd tier set-overlay base cache', 'sudo ceph osd pool set cache hit_set_type bloom', 'sudo ceph osd pool set cache hit_set_count 8', 'sudo ceph osd pool set cache hit_set_period 3600', 'sudo ceph osd pool set cache target_max_objects 250']}}, {'rados': {'clients': ['client.0'], 'objects': 500, 'op_weights': {'cache_evict': 50, 'cache_flush': 50, 'cache_try_flush': 50, 'copy_from': 50, 'delete': 50, 'read': 100, 'rollback': 50, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 4000, 'pool_snaps': True, 'pools': ['base']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '8e1bba12e584b7ae912e92e94afe9c075ab51fa3', 'timestamp': '2023-01-24_22:22:09', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.17735'} 2023-01-25T06:17:38.047 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-01-25T06:17:38.074 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-01-25T06:17:38.091 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/run/ceph 2023-01-25T06:17:38.132 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/run/ceph 2023-01-25T06:17:38.159 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-01-25T06:17:38.159 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/scratch_devs of=/dev/stdout 2023-01-25T06:17:38.216 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-01-25T06:17:38.217 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_1 2023-01-25T06:17:38.273 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-01-25T06:17:38.273 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T06:17:38.274 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 6h/6d Inode: 349721 Links: 1 2023-01-25T06:17:38.274 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T06:17:38.274 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T06:17:38.274 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-01-25 06:17:24.304271262 +0000 2023-01-25T06:17:38.275 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-01-25 06:12:49.721684716 +0000 2023-01-25T06:17:38.275 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-01-25 06:12:49.721684716 +0000 2023-01-25T06:17:38.275 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2023-01-25T06:17:38.276 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-01-25T06:17:38.338 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-01-25T06:17:38.339 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-01-25T06:17:38.339 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000253272 s, 2.0 MB/s 2023-01-25T06:17:38.340 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-01-25T06:17:38.397 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_2 2023-01-25T06:17:38.454 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-01-25T06:17:38.454 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T06:17:38.455 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 6h/6d Inode: 355804 Links: 1 2023-01-25T06:17:38.455 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T06:17:38.455 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T06:17:38.456 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-01-25 06:17:24.304271262 +0000 2023-01-25T06:17:38.456 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-01-25 06:12:50.220674071 +0000 2023-01-25T06:17:38.456 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-01-25 06:12:50.220674071 +0000 2023-01-25T06:17:38.457 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2023-01-25T06:17:38.457 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-01-25T06:17:38.519 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-01-25T06:17:38.520 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-01-25T06:17:38.520 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000247169 s, 2.1 MB/s 2023-01-25T06:17:38.521 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-01-25T06:17:38.579 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_3 2023-01-25T06:17:38.636 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-01-25T06:17:38.636 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T06:17:38.636 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 6h/6d Inode: 355879 Links: 1 2023-01-25T06:17:38.637 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T06:17:38.637 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T06:17:38.637 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-01-25 06:17:24.304271262 +0000 2023-01-25T06:17:38.637 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-01-25 06:12:50.711663598 +0000 2023-01-25T06:17:38.638 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-01-25 06:12:50.711663598 +0000 2023-01-25T06:17:38.638 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2023-01-25T06:17:38.638 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-01-25T06:17:38.701 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-01-25T06:17:38.701 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-01-25T06:17:38.701 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000225004 s, 2.3 MB/s 2023-01-25T06:17:38.702 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-01-25T06:17:38.760 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_4 2023-01-25T06:17:38.817 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-01-25T06:17:38.817 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T06:17:38.817 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 6h/6d Inode: 353029 Links: 1 2023-01-25T06:17:38.817 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T06:17:38.818 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T06:17:38.818 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-01-25 06:17:24.305271242 +0000 2023-01-25T06:17:38.818 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-01-25 06:12:51.221652718 +0000 2023-01-25T06:17:38.818 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-01-25 06:12:51.221652718 +0000 2023-01-25T06:17:38.818 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2023-01-25T06:17:38.819 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-01-25T06:17:38.882 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-01-25T06:17:38.882 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-01-25T06:17:38.883 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000185456 s, 2.8 MB/s 2023-01-25T06:17:38.883 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-01-25T06:17:38.940 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T06:17:38.941 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-01-25T06:17:38.941 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/scratch_devs of=/dev/stdout 2023-01-25T06:17:38.961 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-01-25T06:17:38.962 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_1 2023-01-25T06:17:39.022 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-01-25T06:17:39.022 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T06:17:39.023 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 355662 Links: 1 2023-01-25T06:17:39.023 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T06:17:39.023 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T06:17:39.024 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-01-25 06:17:24.956077202 +0000 2023-01-25T06:17:39.024 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-01-25 06:12:51.206455992 +0000 2023-01-25T06:17:39.024 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-01-25 06:12:51.206455992 +0000 2023-01-25T06:17:39.024 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2023-01-25T06:17:39.025 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-01-25T06:17:39.092 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-01-25T06:17:39.092 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-01-25T06:17:39.093 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000291776 s, 1.8 MB/s 2023-01-25T06:17:39.093 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-01-25T06:17:39.154 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_2 2023-01-25T06:17:39.214 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-01-25T06:17:39.214 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T06:17:39.214 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 355740 Links: 1 2023-01-25T06:17:39.215 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T06:17:39.215 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T06:17:39.215 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-01-25 06:17:24.957077180 +0000 2023-01-25T06:17:39.215 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-01-25 06:12:51.700444590 +0000 2023-01-25T06:17:39.215 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-01-25 06:12:51.700444590 +0000 2023-01-25T06:17:39.216 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2023-01-25T06:17:39.216 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-01-25T06:17:39.284 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-01-25T06:17:39.285 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-01-25T06:17:39.285 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000297515 s, 1.7 MB/s 2023-01-25T06:17:39.286 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-01-25T06:17:39.346 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_3 2023-01-25T06:17:39.404 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-01-25T06:17:39.405 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T06:17:39.405 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 357242 Links: 1 2023-01-25T06:17:39.405 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T06:17:39.405 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T06:17:39.406 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-01-25 06:17:24.957077180 +0000 2023-01-25T06:17:39.406 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-01-25 06:12:52.194433189 +0000 2023-01-25T06:17:39.406 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-01-25 06:12:52.194433189 +0000 2023-01-25T06:17:39.406 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2023-01-25T06:17:39.406 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-01-25T06:17:39.472 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-01-25T06:17:39.472 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-01-25T06:17:39.473 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.00023612 s, 2.2 MB/s 2023-01-25T06:17:39.474 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-01-25T06:17:39.532 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_4 2023-01-25T06:17:39.590 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-01-25T06:17:39.591 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T06:17:39.591 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 357321 Links: 1 2023-01-25T06:17:39.591 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T06:17:39.591 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T06:17:39.592 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-01-25 06:17:24.957077180 +0000 2023-01-25T06:17:39.592 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-01-25 06:12:52.678422078 +0000 2023-01-25T06:17:39.592 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-01-25 06:12:52.678422078 +0000 2023-01-25T06:17:39.592 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2023-01-25T06:17:39.593 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-01-25T06:17:39.658 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-01-25T06:17:39.658 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-01-25T06:17:39.658 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000213696 s, 2.4 MB/s 2023-01-25T06:17:39.659 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-01-25T06:17:39.718 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T06:17:39.718 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-01-25T06:17:39.718 INFO:tasks.ceph:Generating config... 2023-01-25T06:17:39.720 INFO:tasks.ceph:[osd] debug monc = 20 2023-01-25T06:17:39.720 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2023-01-25T06:17:39.720 INFO:tasks.ceph:[osd] debug ms = 1 2023-01-25T06:17:39.721 INFO:tasks.ceph:[osd] debug osd = 20 2023-01-25T06:17:39.721 INFO:tasks.ceph:[osd] osd backoff on degraded = True 2023-01-25T06:17:39.721 INFO:tasks.ceph:[osd] osd backoff on peering = True 2023-01-25T06:17:39.721 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2023-01-25T06:17:39.722 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2023-01-25T06:17:39.722 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2023-01-25T06:17:39.722 INFO:tasks.ceph:[osd] osd inject bad map crc probability = 0.1 2023-01-25T06:17:39.722 INFO:tasks.ceph:[osd] osd map cache size = 1 2023-01-25T06:17:39.723 INFO:tasks.ceph:[osd] osd max backfills = 6 2023-01-25T06:17:39.723 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2023-01-25T06:17:39.723 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2023-01-25T06:17:39.723 INFO:tasks.ceph:[osd] osd objectstore = filestore 2023-01-25T06:17:39.724 INFO:tasks.ceph:[osd] osd op queue = debug_random 2023-01-25T06:17:39.724 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2023-01-25T06:17:39.724 INFO:tasks.ceph:[osd] osd scrub during recovery = False 2023-01-25T06:17:39.724 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2023-01-25T06:17:39.725 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2023-01-25T06:17:39.725 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-01-25T06:17:39.725 INFO:tasks.ceph:[osd] osd sloppy crc = True 2023-01-25T06:17:39.725 INFO:tasks.ceph:[osd] osd_max_pg_log_entries = 3000 2023-01-25T06:17:39.726 INFO:tasks.ceph:[osd] osd_min_pg_log_entries = 3000 2023-01-25T06:17:39.726 INFO:tasks.ceph:[global] mon election default strategy = 1 2023-01-25T06:17:39.726 INFO:tasks.ceph:[global] ms type = async 2023-01-25T06:17:39.727 INFO:tasks.ceph:[global] osd debug inject dispatch delay duration = 0.1 2023-01-25T06:17:39.727 INFO:tasks.ceph:[global] osd debug inject dispatch delay probability = 0.1 2023-01-25T06:17:39.727 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2023-01-25T06:17:39.727 INFO:tasks.ceph:[global] osd_pool_default_size = 2 2023-01-25T06:17:39.728 INFO:tasks.ceph:[global] osd_recovery_max_active = 10 2023-01-25T06:17:39.728 INFO:tasks.ceph:[global] osd_recovery_max_single_start = 10 2023-01-25T06:17:39.728 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-01-25T06:17:39.728 INFO:tasks.ceph:[mgr] debug ms = 1 2023-01-25T06:17:39.729 INFO:tasks.ceph:[mon] debug mon = 20 2023-01-25T06:17:39.729 INFO:tasks.ceph:[mon] debug ms = 1 2023-01-25T06:17:39.729 INFO:tasks.ceph:[mon] debug paxos = 20 2023-01-25T06:17:39.729 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2023-01-25T06:17:39.730 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2023-01-25T06:17:39.730 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2023-01-25T06:17:39.730 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2023-01-25T06:17:39.730 INFO:tasks.ceph:[mon] mon scrub interval = 300 2023-01-25T06:17:39.731 INFO:tasks.ceph:[mon] paxos service trim min = 10 2023-01-25T06:17:39.731 INFO:tasks.ceph:Setting up mon.a... 2023-01-25T06:17:39.731 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-01-25T06:17:39.783 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.keyring 2023-01-25T06:17:39.786 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-01-25T06:17:39.832 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-25T06:17:39.858 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.88'), ('mon.c', '[v2:172.21.15.88:3301,v1:172.21.15.88:6790]'), ('mon.b', '172.21.15.89')] 2023-01-25T06:17:39.859 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.88,[v2:172.21.15.88:3301,v1:172.21.15.88:6790],172.21.15.89', 'mon election default strategy': 1, 'ms type': 'async', 'osd debug inject dispatch delay duration': 0.1, 'osd debug inject dispatch delay probability': 0.1, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd backoff on degraded': True, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd inject bad map crc probability': 0.1, 'osd map cache size': 1, 'osd max backfills': 6, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'filestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub during recovery': False, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd sloppy crc': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2023-01-25T06:17:39.860 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-01-25T06:17:39.861 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-01-25T06:17:39.915 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.88 --addv c '[v2:172.21.15.88:3301,v1:172.21.15.88:6790]' --add b 172.21.15.89 --print /home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:17:40.002 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:17:40.002 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: generated fsid 46db3fbd-f892-4dd1-b3a1-5ebdf38661bb 2023-01-25T06:17:40.002 INFO:teuthology.orchestra.run.smithi088.stdout:setting min_mon_release = pacific 2023-01-25T06:17:40.003 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 0 2023-01-25T06:17:40.003 INFO:teuthology.orchestra.run.smithi088.stdout:fsid 46db3fbd-f892-4dd1-b3a1-5ebdf38661bb 2023-01-25T06:17:40.003 INFO:teuthology.orchestra.run.smithi088.stdout:last_changed 2023-01-25T06:17:40.002340+0000 2023-01-25T06:17:40.003 INFO:teuthology.orchestra.run.smithi088.stdout:created 2023-01-25T06:17:40.002340+0000 2023-01-25T06:17:40.003 INFO:teuthology.orchestra.run.smithi088.stdout:min_mon_release 16 (pacific) 2023-01-25T06:17:40.004 INFO:teuthology.orchestra.run.smithi088.stdout:election_strategy: 1 2023-01-25T06:17:40.004 INFO:teuthology.orchestra.run.smithi088.stdout:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2023-01-25T06:17:40.004 INFO:teuthology.orchestra.run.smithi088.stdout:1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.b 2023-01-25T06:17:40.004 INFO:teuthology.orchestra.run.smithi088.stdout:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2023-01-25T06:17:40.004 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-01-25T06:17:40.006 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-01-25T06:17:40.022 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 46db3fbd-f892-4dd1-b3a1-5ebdf38661bb... 2023-01-25T06:17:40.023 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-01-25T06:17:40.065 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-01-25T06:17:40.106 INFO:teuthology.orchestra.run.smithi088.stdout:[global] 2023-01-25T06:17:40.106 INFO:teuthology.orchestra.run.smithi088.stdout: chdir = "" 2023-01-25T06:17:40.107 INFO:teuthology.orchestra.run.smithi088.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-01-25T06:17:40.107 INFO:teuthology.orchestra.run.smithi088.stdout: auth supported = cephx 2023-01-25T06:17:40.107 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.107 INFO:teuthology.orchestra.run.smithi088.stdout: filestore xattr use omap = true 2023-01-25T06:17:40.107 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.108 INFO:teuthology.orchestra.run.smithi088.stdout: mon clock drift allowed = 1.000 2023-01-25T06:17:40.108 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.108 INFO:teuthology.orchestra.run.smithi088.stdout: osd crush chooseleaf type = 0 2023-01-25T06:17:40.108 INFO:teuthology.orchestra.run.smithi088.stdout: auth debug = true 2023-01-25T06:17:40.108 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.109 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on old message = true 2023-01-25T06:17:40.109 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on bug = true 2023-01-25T06:17:40.109 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.109 INFO:teuthology.orchestra.run.smithi088.stdout: mon max pg per osd = 10000 # >= luminous 2023-01-25T06:17:40.110 INFO:teuthology.orchestra.run.smithi088.stdout: mon pg warn max object skew = 0 2023-01-25T06:17:40.110 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.110 INFO:teuthology.orchestra.run.smithi088.stdout: # disable pg_autoscaler by default for new pools 2023-01-25T06:17:40.110 INFO:teuthology.orchestra.run.smithi088.stdout: osd_pool_default_pg_autoscale_mode = off 2023-01-25T06:17:40.110 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.111 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default size = 2 2023-01-25T06:17:40.111 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.111 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow primary affinity = true 2023-01-25T06:17:40.111 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow pg remap = true 2023-01-25T06:17:40.111 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on legacy crush tunables = false 2023-01-25T06:17:40.112 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on crush straw calc version zero = false 2023-01-25T06:17:40.112 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on no sortbitwise = false 2023-01-25T06:17:40.112 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on osd down out interval zero = false 2023-01-25T06:17:40.112 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on too few osds = false 2023-01-25T06:17:40.112 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-01-25T06:17:40.113 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_no_redundancy = false 2023-01-25T06:17:40.113 INFO:teuthology.orchestra.run.smithi088.stdout: mon_allow_pool_size_one = true 2023-01-25T06:17:40.113 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.113 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-01-25T06:17:40.113 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.113 INFO:teuthology.orchestra.run.smithi088.stdout: osd default data pool replay window = 5 2023-01-25T06:17:40.114 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.114 INFO:teuthology.orchestra.run.smithi088.stdout: mon allow pool delete = true 2023-01-25T06:17:40.114 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.114 INFO:teuthology.orchestra.run.smithi088.stdout: mon cluster log file level = debug 2023-01-25T06:17:40.114 INFO:teuthology.orchestra.run.smithi088.stdout: debug asserts on shutdown = true 2023-01-25T06:17:40.115 INFO:teuthology.orchestra.run.smithi088.stdout: mon health detail to clog = false 2023-01-25T06:17:40.115 INFO:teuthology.orchestra.run.smithi088.stdout: mon host = "172.21.15.88,[v2:172.21.15.88:3301,v1:172.21.15.88:6790],172.21.15.89" 2023-01-25T06:17:40.115 INFO:teuthology.orchestra.run.smithi088.stdout: mon election default strategy = 1 2023-01-25T06:17:40.115 INFO:teuthology.orchestra.run.smithi088.stdout: ms type = async 2023-01-25T06:17:40.115 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug inject dispatch delay duration = 0.1 2023-01-25T06:17:40.116 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug inject dispatch delay probability = 0.1 2023-01-25T06:17:40.116 INFO:teuthology.orchestra.run.smithi088.stdout: osd_pool_default_min_size = 2 2023-01-25T06:17:40.116 INFO:teuthology.orchestra.run.smithi088.stdout: osd_pool_default_size = 2 2023-01-25T06:17:40.116 INFO:teuthology.orchestra.run.smithi088.stdout: osd_recovery_max_active = 10 2023-01-25T06:17:40.116 INFO:teuthology.orchestra.run.smithi088.stdout: osd_recovery_max_single_start = 10 2023-01-25T06:17:40.117 INFO:teuthology.orchestra.run.smithi088.stdout: fsid = 46db3fbd-f892-4dd1-b3a1-5ebdf38661bb 2023-01-25T06:17:40.117 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.117 INFO:teuthology.orchestra.run.smithi088.stdout:[osd] 2023-01-25T06:17:40.117 INFO:teuthology.orchestra.run.smithi088.stdout: osd journal size = 100 2023-01-25T06:17:40.117 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.117 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub load threshold = 5.0 2023-01-25T06:17:40.118 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub max interval = 120 2023-01-25T06:17:40.118 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.118 INFO:teuthology.orchestra.run.smithi088.stdout: osd recover clone overlap = true 2023-01-25T06:17:40.118 INFO:teuthology.orchestra.run.smithi088.stdout: osd recovery max chunk = 1048576 2023-01-25T06:17:40.118 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.119 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug shutdown = true 2023-01-25T06:17:40.119 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug op order = true 2023-01-25T06:17:40.119 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug verify stray on activate = true 2023-01-25T06:17:40.119 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.119 INFO:teuthology.orchestra.run.smithi088.stdout: osd open classes on start = true 2023-01-25T06:17:40.120 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug pg log writeout = true 2023-01-25T06:17:40.120 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.120 INFO:teuthology.orchestra.run.smithi088.stdout: osd deep scrub update digest min age = 30 2023-01-25T06:17:40.120 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.120 INFO:teuthology.orchestra.run.smithi088.stdout: osd map max advance = 10 2023-01-25T06:17:40.121 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.121 INFO:teuthology.orchestra.run.smithi088.stdout: journal zero on create = true 2023-01-25T06:17:40.121 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.121 INFO:teuthology.orchestra.run.smithi088.stdout: filestore ondisk finisher threads = 3 2023-01-25T06:17:40.121 INFO:teuthology.orchestra.run.smithi088.stdout: filestore apply finisher threads = 3 2023-01-25T06:17:40.122 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.122 INFO:teuthology.orchestra.run.smithi088.stdout: bdev debug aio = true 2023-01-25T06:17:40.122 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug misdirected ops = true 2023-01-25T06:17:40.122 INFO:teuthology.orchestra.run.smithi088.stdout: debug monc = 20 2023-01-25T06:17:40.122 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore zero block detection = True 2023-01-25T06:17:40.122 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-01-25T06:17:40.123 INFO:teuthology.orchestra.run.smithi088.stdout: debug osd = 20 2023-01-25T06:17:40.123 INFO:teuthology.orchestra.run.smithi088.stdout: osd backoff on degraded = True 2023-01-25T06:17:40.123 INFO:teuthology.orchestra.run.smithi088.stdout: osd backoff on peering = True 2023-01-25T06:17:40.123 INFO:teuthology.orchestra.run.smithi088.stdout: osd blocked scrub grace period = 3600 2023-01-25T06:17:40.123 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug verify cached snaps = True 2023-01-25T06:17:40.124 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug verify missing on start = True 2023-01-25T06:17:40.124 INFO:teuthology.orchestra.run.smithi088.stdout: osd inject bad map crc probability = 0.1 2023-01-25T06:17:40.124 INFO:teuthology.orchestra.run.smithi088.stdout: osd map cache size = 1 2023-01-25T06:17:40.124 INFO:teuthology.orchestra.run.smithi088.stdout: osd max backfills = 6 2023-01-25T06:17:40.124 INFO:teuthology.orchestra.run.smithi088.stdout: osd max markdown count = 1000 2023-01-25T06:17:40.125 INFO:teuthology.orchestra.run.smithi088.stdout: osd mclock override recovery settings = True 2023-01-25T06:17:40.125 INFO:teuthology.orchestra.run.smithi088.stdout: osd objectstore = filestore 2023-01-25T06:17:40.125 INFO:teuthology.orchestra.run.smithi088.stdout: osd op queue = debug_random 2023-01-25T06:17:40.125 INFO:teuthology.orchestra.run.smithi088.stdout: osd op queue cut off = debug_random 2023-01-25T06:17:40.125 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub during recovery = False 2023-01-25T06:17:40.126 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub min interval = 60 2023-01-25T06:17:40.126 INFO:teuthology.orchestra.run.smithi088.stdout: osd shutdown pgref assert = True 2023-01-25T06:17:40.126 INFO:teuthology.orchestra.run.smithi088.stdout: osd sloppy crc = True 2023-01-25T06:17:40.126 INFO:teuthology.orchestra.run.smithi088.stdout: osd_max_pg_log_entries = 3000 2023-01-25T06:17:40.126 INFO:teuthology.orchestra.run.smithi088.stdout: osd_min_pg_log_entries = 3000 2023-01-25T06:17:40.127 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.127 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr] 2023-01-25T06:17:40.127 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-01-25T06:17:40.127 INFO:teuthology.orchestra.run.smithi088.stdout: debug mgr = 20 2023-01-25T06:17:40.127 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2023-01-25T06:17:40.128 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2023-01-25T06:17:40.128 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2023-01-25T06:17:40.128 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2023-01-25T06:17:40.128 INFO:teuthology.orchestra.run.smithi088.stdout: mgr/telemetry/nag = false 2023-01-25T06:17:40.128 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.128 INFO:teuthology.orchestra.run.smithi088.stdout:[mon] 2023-01-25T06:17:40.129 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-01-25T06:17:40.129 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2023-01-25T06:17:40.129 INFO:teuthology.orchestra.run.smithi088.stdout: debug paxos = 20 2023-01-25T06:17:40.129 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2023-01-25T06:17:40.129 INFO:teuthology.orchestra.run.smithi088.stdout: mon data avail warn = 5 2023-01-25T06:17:40.130 INFO:teuthology.orchestra.run.smithi088.stdout: mon mgr mkfs grace = 240 2023-01-25T06:17:40.130 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2023-01-25T06:17:40.130 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd reporter subtree level = osd 2023-01-25T06:17:40.130 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd prime pg temp = true 2023-01-25T06:17:40.130 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2023-01-25T06:17:40.131 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.131 INFO:teuthology.orchestra.run.smithi088.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-01-25T06:17:40.131 INFO:teuthology.orchestra.run.smithi088.stdout: auth mon ticket ttl = 660 # 11m 2023-01-25T06:17:40.131 INFO:teuthology.orchestra.run.smithi088.stdout: auth service ticket ttl = 240 # 4m 2023-01-25T06:17:40.131 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.132 INFO:teuthology.orchestra.run.smithi088.stdout: # don't complain about insecure global_id in the test suite 2023-01-25T06:17:40.132 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-01-25T06:17:40.132 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-01-25T06:17:40.132 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.132 INFO:teuthology.orchestra.run.smithi088.stdout: # 1m isn't quite enough 2023-01-25T06:17:40.132 INFO:teuthology.orchestra.run.smithi088.stdout: mon_down_mkfs_grace = 2m 2023-01-25T06:17:40.133 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.133 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_filestore_osds = false 2023-01-25T06:17:40.133 INFO:teuthology.orchestra.run.smithi088.stdout: mon min osdmap epochs = 50 2023-01-25T06:17:40.133 INFO:teuthology.orchestra.run.smithi088.stdout: mon osdmap full prune interval = 2 2023-01-25T06:17:40.133 INFO:teuthology.orchestra.run.smithi088.stdout: mon osdmap full prune min = 15 2023-01-25T06:17:40.134 INFO:teuthology.orchestra.run.smithi088.stdout: mon osdmap full prune txsize = 2 2023-01-25T06:17:40.134 INFO:teuthology.orchestra.run.smithi088.stdout: mon scrub interval = 300 2023-01-25T06:17:40.134 INFO:teuthology.orchestra.run.smithi088.stdout: paxos service trim min = 10 2023-01-25T06:17:40.134 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:40.134 INFO:teuthology.orchestra.run.smithi088.stdout:[client] 2023-01-25T06:17:40.135 INFO:teuthology.orchestra.run.smithi088.stdout: rgw cache enabled = true 2023-01-25T06:17:40.135 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable ops log = true 2023-01-25T06:17:40.135 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable usage log = true 2023-01-25T06:17:40.135 INFO:teuthology.orchestra.run.smithi088.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-01-25T06:17:40.136 INFO:teuthology.orchestra.run.smithi088.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-01-25T06:17:40.136 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.a] 2023-01-25T06:17:40.136 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.c] 2023-01-25T06:17:40.136 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.b] 2023-01-25T06:17:40.138 INFO:teuthology.orchestra.run.smithi089.stdout:[global] 2023-01-25T06:17:40.138 INFO:teuthology.orchestra.run.smithi089.stdout: chdir = "" 2023-01-25T06:17:40.138 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-01-25T06:17:40.138 INFO:teuthology.orchestra.run.smithi089.stdout: auth supported = cephx 2023-01-25T06:17:40.139 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.139 INFO:teuthology.orchestra.run.smithi089.stdout: filestore xattr use omap = true 2023-01-25T06:17:40.139 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.139 INFO:teuthology.orchestra.run.smithi089.stdout: mon clock drift allowed = 1.000 2023-01-25T06:17:40.139 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.139 INFO:teuthology.orchestra.run.smithi089.stdout: osd crush chooseleaf type = 0 2023-01-25T06:17:40.140 INFO:teuthology.orchestra.run.smithi089.stdout: auth debug = true 2023-01-25T06:17:40.140 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.140 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on old message = true 2023-01-25T06:17:40.140 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on bug = true 2023-01-25T06:17:40.140 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.141 INFO:teuthology.orchestra.run.smithi089.stdout: mon max pg per osd = 10000 # >= luminous 2023-01-25T06:17:40.141 INFO:teuthology.orchestra.run.smithi089.stdout: mon pg warn max object skew = 0 2023-01-25T06:17:40.141 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.141 INFO:teuthology.orchestra.run.smithi089.stdout: # disable pg_autoscaler by default for new pools 2023-01-25T06:17:40.141 INFO:teuthology.orchestra.run.smithi089.stdout: osd_pool_default_pg_autoscale_mode = off 2023-01-25T06:17:40.142 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.142 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default size = 2 2023-01-25T06:17:40.142 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.142 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow primary affinity = true 2023-01-25T06:17:40.142 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow pg remap = true 2023-01-25T06:17:40.143 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on legacy crush tunables = false 2023-01-25T06:17:40.143 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on crush straw calc version zero = false 2023-01-25T06:17:40.143 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on no sortbitwise = false 2023-01-25T06:17:40.143 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on osd down out interval zero = false 2023-01-25T06:17:40.143 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on too few osds = false 2023-01-25T06:17:40.144 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-01-25T06:17:40.144 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_no_redundancy = false 2023-01-25T06:17:40.144 INFO:teuthology.orchestra.run.smithi089.stdout: mon_allow_pool_size_one = true 2023-01-25T06:17:40.144 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.144 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-01-25T06:17:40.145 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.145 INFO:teuthology.orchestra.run.smithi089.stdout: osd default data pool replay window = 5 2023-01-25T06:17:40.145 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.145 INFO:teuthology.orchestra.run.smithi089.stdout: mon allow pool delete = true 2023-01-25T06:17:40.145 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.146 INFO:teuthology.orchestra.run.smithi089.stdout: mon cluster log file level = debug 2023-01-25T06:17:40.146 INFO:teuthology.orchestra.run.smithi089.stdout: debug asserts on shutdown = true 2023-01-25T06:17:40.146 INFO:teuthology.orchestra.run.smithi089.stdout: mon health detail to clog = false 2023-01-25T06:17:40.146 INFO:teuthology.orchestra.run.smithi089.stdout: mon host = "172.21.15.88,[v2:172.21.15.88:3301,v1:172.21.15.88:6790],172.21.15.89" 2023-01-25T06:17:40.146 INFO:teuthology.orchestra.run.smithi089.stdout: mon election default strategy = 1 2023-01-25T06:17:40.147 INFO:teuthology.orchestra.run.smithi089.stdout: ms type = async 2023-01-25T06:17:40.147 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug inject dispatch delay duration = 0.1 2023-01-25T06:17:40.147 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug inject dispatch delay probability = 0.1 2023-01-25T06:17:40.147 INFO:teuthology.orchestra.run.smithi089.stdout: osd_pool_default_min_size = 2 2023-01-25T06:17:40.147 INFO:teuthology.orchestra.run.smithi089.stdout: osd_pool_default_size = 2 2023-01-25T06:17:40.148 INFO:teuthology.orchestra.run.smithi089.stdout: osd_recovery_max_active = 10 2023-01-25T06:17:40.148 INFO:teuthology.orchestra.run.smithi089.stdout: osd_recovery_max_single_start = 10 2023-01-25T06:17:40.148 INFO:teuthology.orchestra.run.smithi089.stdout: fsid = 46db3fbd-f892-4dd1-b3a1-5ebdf38661bb 2023-01-25T06:17:40.148 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.148 INFO:teuthology.orchestra.run.smithi089.stdout:[osd] 2023-01-25T06:17:40.149 INFO:teuthology.orchestra.run.smithi089.stdout: osd journal size = 100 2023-01-25T06:17:40.149 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.149 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub load threshold = 5.0 2023-01-25T06:17:40.149 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub max interval = 120 2023-01-25T06:17:40.149 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.150 INFO:teuthology.orchestra.run.smithi089.stdout: osd recover clone overlap = true 2023-01-25T06:17:40.150 INFO:teuthology.orchestra.run.smithi089.stdout: osd recovery max chunk = 1048576 2023-01-25T06:17:40.150 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.150 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug shutdown = true 2023-01-25T06:17:40.150 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug op order = true 2023-01-25T06:17:40.151 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug verify stray on activate = true 2023-01-25T06:17:40.151 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.151 INFO:teuthology.orchestra.run.smithi089.stdout: osd open classes on start = true 2023-01-25T06:17:40.151 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug pg log writeout = true 2023-01-25T06:17:40.151 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.152 INFO:teuthology.orchestra.run.smithi089.stdout: osd deep scrub update digest min age = 30 2023-01-25T06:17:40.152 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.152 INFO:teuthology.orchestra.run.smithi089.stdout: osd map max advance = 10 2023-01-25T06:17:40.152 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.152 INFO:teuthology.orchestra.run.smithi089.stdout: journal zero on create = true 2023-01-25T06:17:40.153 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.153 INFO:teuthology.orchestra.run.smithi089.stdout: filestore ondisk finisher threads = 3 2023-01-25T06:17:40.153 INFO:teuthology.orchestra.run.smithi089.stdout: filestore apply finisher threads = 3 2023-01-25T06:17:40.153 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.153 INFO:teuthology.orchestra.run.smithi089.stdout: bdev debug aio = true 2023-01-25T06:17:40.154 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug misdirected ops = true 2023-01-25T06:17:40.154 INFO:teuthology.orchestra.run.smithi089.stdout: debug monc = 20 2023-01-25T06:17:40.154 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore zero block detection = True 2023-01-25T06:17:40.154 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-01-25T06:17:40.154 INFO:teuthology.orchestra.run.smithi089.stdout: debug osd = 20 2023-01-25T06:17:40.155 INFO:teuthology.orchestra.run.smithi089.stdout: osd backoff on degraded = True 2023-01-25T06:17:40.155 INFO:teuthology.orchestra.run.smithi089.stdout: osd backoff on peering = True 2023-01-25T06:17:40.155 INFO:teuthology.orchestra.run.smithi089.stdout: osd blocked scrub grace period = 3600 2023-01-25T06:17:40.155 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug verify cached snaps = True 2023-01-25T06:17:40.155 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug verify missing on start = True 2023-01-25T06:17:40.156 INFO:teuthology.orchestra.run.smithi089.stdout: osd inject bad map crc probability = 0.1 2023-01-25T06:17:40.156 INFO:teuthology.orchestra.run.smithi089.stdout: osd map cache size = 1 2023-01-25T06:17:40.156 INFO:teuthology.orchestra.run.smithi089.stdout: osd max backfills = 6 2023-01-25T06:17:40.156 INFO:teuthology.orchestra.run.smithi089.stdout: osd max markdown count = 1000 2023-01-25T06:17:40.156 INFO:teuthology.orchestra.run.smithi089.stdout: osd mclock override recovery settings = True 2023-01-25T06:17:40.157 INFO:teuthology.orchestra.run.smithi089.stdout: osd objectstore = filestore 2023-01-25T06:17:40.157 INFO:teuthology.orchestra.run.smithi089.stdout: osd op queue = debug_random 2023-01-25T06:17:40.157 INFO:teuthology.orchestra.run.smithi089.stdout: osd op queue cut off = debug_random 2023-01-25T06:17:40.157 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub during recovery = False 2023-01-25T06:17:40.157 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub min interval = 60 2023-01-25T06:17:40.158 INFO:teuthology.orchestra.run.smithi089.stdout: osd shutdown pgref assert = True 2023-01-25T06:17:40.158 INFO:teuthology.orchestra.run.smithi089.stdout: osd sloppy crc = True 2023-01-25T06:17:40.158 INFO:teuthology.orchestra.run.smithi089.stdout: osd_max_pg_log_entries = 3000 2023-01-25T06:17:40.158 INFO:teuthology.orchestra.run.smithi089.stdout: osd_min_pg_log_entries = 3000 2023-01-25T06:17:40.158 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.158 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr] 2023-01-25T06:17:40.159 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-01-25T06:17:40.159 INFO:teuthology.orchestra.run.smithi089.stdout: debug mgr = 20 2023-01-25T06:17:40.159 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2023-01-25T06:17:40.159 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2023-01-25T06:17:40.159 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2023-01-25T06:17:40.160 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2023-01-25T06:17:40.160 INFO:teuthology.orchestra.run.smithi089.stdout: mgr/telemetry/nag = false 2023-01-25T06:17:40.160 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.160 INFO:teuthology.orchestra.run.smithi089.stdout:[mon] 2023-01-25T06:17:40.160 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-01-25T06:17:40.161 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2023-01-25T06:17:40.161 INFO:teuthology.orchestra.run.smithi089.stdout: debug paxos = 20 2023-01-25T06:17:40.161 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2023-01-25T06:17:40.161 INFO:teuthology.orchestra.run.smithi089.stdout: mon data avail warn = 5 2023-01-25T06:17:40.161 INFO:teuthology.orchestra.run.smithi089.stdout: mon mgr mkfs grace = 240 2023-01-25T06:17:40.162 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2023-01-25T06:17:40.162 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd reporter subtree level = osd 2023-01-25T06:17:40.162 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd prime pg temp = true 2023-01-25T06:17:40.162 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2023-01-25T06:17:40.162 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.163 INFO:teuthology.orchestra.run.smithi089.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-01-25T06:17:40.163 INFO:teuthology.orchestra.run.smithi089.stdout: auth mon ticket ttl = 660 # 11m 2023-01-25T06:17:40.163 INFO:teuthology.orchestra.run.smithi089.stdout: auth service ticket ttl = 240 # 4m 2023-01-25T06:17:40.163 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.163 INFO:teuthology.orchestra.run.smithi089.stdout: # don't complain about insecure global_id in the test suite 2023-01-25T06:17:40.164 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-01-25T06:17:40.164 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-01-25T06:17:40.164 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.164 INFO:teuthology.orchestra.run.smithi089.stdout: # 1m isn't quite enough 2023-01-25T06:17:40.164 INFO:teuthology.orchestra.run.smithi089.stdout: mon_down_mkfs_grace = 2m 2023-01-25T06:17:40.165 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.165 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_filestore_osds = false 2023-01-25T06:17:40.165 INFO:teuthology.orchestra.run.smithi089.stdout: mon min osdmap epochs = 50 2023-01-25T06:17:40.165 INFO:teuthology.orchestra.run.smithi089.stdout: mon osdmap full prune interval = 2 2023-01-25T06:17:40.165 INFO:teuthology.orchestra.run.smithi089.stdout: mon osdmap full prune min = 15 2023-01-25T06:17:40.165 INFO:teuthology.orchestra.run.smithi089.stdout: mon osdmap full prune txsize = 2 2023-01-25T06:17:40.166 INFO:teuthology.orchestra.run.smithi089.stdout: mon scrub interval = 300 2023-01-25T06:17:40.166 INFO:teuthology.orchestra.run.smithi089.stdout: paxos service trim min = 10 2023-01-25T06:17:40.166 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T06:17:40.166 INFO:teuthology.orchestra.run.smithi089.stdout:[client] 2023-01-25T06:17:40.166 INFO:teuthology.orchestra.run.smithi089.stdout: rgw cache enabled = true 2023-01-25T06:17:40.167 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable ops log = true 2023-01-25T06:17:40.167 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable usage log = true 2023-01-25T06:17:40.167 INFO:teuthology.orchestra.run.smithi089.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-01-25T06:17:40.167 INFO:teuthology.orchestra.run.smithi089.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-01-25T06:17:40.167 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.a] 2023-01-25T06:17:40.168 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.c] 2023-01-25T06:17:40.168 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.b] 2023-01-25T06:17:40.168 INFO:tasks.ceph:Creating admin key on mon.a... 2023-01-25T06:17:40.169 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-01-25T06:17:40.233 INFO:tasks.ceph:Copying monmap to all nodes... 2023-01-25T06:17:40.233 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-01-25T06:17:40.234 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-01-25T06:17:40.250 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-01-25T06:17:40.251 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-01-25T06:17:40.306 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi088.front.sepia.ceph.com 2023-01-25T06:17:40.307 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-01-25T06:17:40.307 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.keyring 2023-01-25T06:17:40.307 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-25T06:17:40.382 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-01-25T06:17:40.382 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:17:40.439 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi089.front.sepia.ceph.com 2023-01-25T06:17:40.440 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-01-25T06:17:40.440 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.keyring 2023-01-25T06:17:40.440 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-25T06:17:40.480 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-01-25T06:17:40.480 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:17:40.537 INFO:tasks.ceph:Setting up mon nodes... 2023-01-25T06:17:40.538 INFO:tasks.ceph:Setting up mgr nodes... 2023-01-25T06:17:40.539 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-01-25T06:17:40.592 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-01-25T06:17:40.594 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-01-25T06:17:40.658 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-01-25T06:17:40.661 INFO:tasks.ceph:Setting up mds nodes... 2023-01-25T06:17:40.661 INFO:tasks.ceph_client:Setting up client nodes... 2023-01-25T06:17:40.662 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-01-25T06:17:40.705 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-01-25T06:17:40.717 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-01-25T06:17:40.762 INFO:teuthology.orchestra.run.smithi089.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-01-25T06:17:40.776 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-01-25T06:17:40.776 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-01-25T06:17:40.776 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-01-25T06:17:40.803 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T06:17:40.803 INFO:tasks.ceph:role: osd.0 2023-01-25T06:17:40.803 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com 2023-01-25T06:17:40.803 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-01-25T06:17:40.877 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T06:17:40.877 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T06:17:40.877 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T06:17:40.877 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T06:17:40.878 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T06:17:40.878 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-01-25T06:17:40.878 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T06:17:40.878 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T06:17:40.878 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T06:17:40.878 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T06:17:41.300 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-01-25T06:17:41.301 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-01-25T06:17:41.302 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-01-25T06:17:41.477 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-01-25T06:17:41.508 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-01-25T06:17:41.575 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T06:17:41.575 INFO:tasks.ceph:role: osd.1 2023-01-25T06:17:41.575 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com 2023-01-25T06:17:41.576 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-01-25T06:17:41.648 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T06:17:41.649 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T06:17:41.649 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T06:17:41.649 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T06:17:41.649 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T06:17:41.649 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-01-25T06:17:41.650 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T06:17:41.650 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T06:17:41.650 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T06:17:41.650 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T06:17:42.075 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-01-25T06:17:42.077 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-01-25T06:17:42.077 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-01-25T06:17:42.192 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-01-25T06:17:42.221 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-01-25T06:17:42.288 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T06:17:42.288 INFO:tasks.ceph:role: osd.2 2023-01-25T06:17:42.288 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com 2023-01-25T06:17:42.289 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-01-25T06:17:42.361 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T06:17:42.362 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T06:17:42.362 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T06:17:42.362 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T06:17:42.362 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T06:17:42.362 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-01-25T06:17:42.363 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T06:17:42.363 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T06:17:42.363 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T06:17:42.363 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T06:17:42.802 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-01-25T06:17:42.803 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-01-25T06:17:42.804 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-01-25T06:17:42.949 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-01-25T06:17:42.979 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-01-25T06:17:43.045 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T06:17:43.046 INFO:tasks.ceph:role: osd.3 2023-01-25T06:17:43.046 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com 2023-01-25T06:17:43.046 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-01-25T06:17:43.119 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T06:17:43.120 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T06:17:43.120 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T06:17:43.120 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T06:17:43.120 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T06:17:43.120 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-01-25T06:17:43.121 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T06:17:43.121 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T06:17:43.121 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T06:17:43.121 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T06:17:43.556 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-01-25T06:17:43.558 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-01-25T06:17:43.559 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-01-25T06:17:43.723 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-01-25T06:17:43.757 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:17:43.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:43.857+0000 7f5ccd6535c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-01-25T06:17:43.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:43.857+0000 7f5ccd6535c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-01-25T06:17:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:43.865+0000 7f5ccd6535c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-25T06:17:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:43.865+0000 7f5ccd6535c0 -1 journal FileJournal::_open_file : zeroing journal 2023-01-25T06:17:44.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:44.082+0000 7f5ccd6535c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-25T06:17:44.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:44.083+0000 7f5ccd6535c0 -1 journal do_read_entry(4096): bad header magic 2023-01-25T06:17:44.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:44.083+0000 7f5ccd6535c0 -1 journal do_read_entry(4096): bad header magic 2023-01-25T06:17:44.102 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-01-25T06:17:44.138 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:17:44.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:44.222+0000 7f5facea55c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-01-25T06:17:44.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:44.222+0000 7f5facea55c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-01-25T06:17:44.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:44.227+0000 7f5facea55c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-25T06:17:44.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:44.227+0000 7f5facea55c0 -1 journal FileJournal::_open_file : zeroing journal 2023-01-25T06:17:44.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:44.388+0000 7f5facea55c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-25T06:17:44.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:44.389+0000 7f5facea55c0 -1 journal do_read_entry(4096): bad header magic 2023-01-25T06:17:44.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:44.389+0000 7f5facea55c0 -1 journal do_read_entry(4096): bad header magic 2023-01-25T06:17:44.399 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-01-25T06:17:44.425 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:17:44.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:44.508+0000 7f039b2725c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-01-25T06:17:44.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:44.508+0000 7f039b2725c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-01-25T06:17:44.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:44.513+0000 7f039b2725c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-25T06:17:44.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:44.513+0000 7f039b2725c0 -1 journal FileJournal::_open_file : zeroing journal 2023-01-25T06:17:44.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:44.643+0000 7f039b2725c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-25T06:17:44.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:44.645+0000 7f039b2725c0 -1 journal do_read_entry(4096): bad header magic 2023-01-25T06:17:44.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:44.645+0000 7f039b2725c0 -1 journal do_read_entry(4096): bad header magic 2023-01-25T06:17:44.657 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-01-25T06:17:44.684 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:17:44.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:44.768+0000 7f337f4c95c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-01-25T06:17:44.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:44.768+0000 7f337f4c95c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-01-25T06:17:44.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:44.775+0000 7f337f4c95c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-25T06:17:44.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:44.775+0000 7f337f4c95c0 -1 journal FileJournal::_open_file : zeroing journal 2023-01-25T06:17:44.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:44.904+0000 7f337f4c95c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-25T06:17:44.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:44.906+0000 7f337f4c95c0 -1 journal do_read_entry(4096): bad header magic 2023-01-25T06:17:44.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-01-25T06:17:44.906+0000 7f337f4c95c0 -1 journal do_read_entry(4096): bad header magic 2023-01-25T06:17:44.916 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-01-25T06:17:44.942 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-01-25T06:17:44.973 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T06:17:44.974 INFO:tasks.ceph:role: osd.4 2023-01-25T06:17:44.974 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com 2023-01-25T06:17:44.974 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-01-25T06:17:45.051 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T06:17:45.051 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T06:17:45.051 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T06:17:45.051 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T06:17:45.052 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T06:17:45.052 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-01-25T06:17:45.052 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T06:17:45.052 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T06:17:45.052 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T06:17:45.053 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T06:17:45.475 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-01-25T06:17:45.478 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-01-25T06:17:45.478 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-01-25T06:17:45.658 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-01-25T06:17:45.698 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-01-25T06:17:45.766 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T06:17:45.767 INFO:tasks.ceph:role: osd.5 2023-01-25T06:17:45.767 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com 2023-01-25T06:17:45.767 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-01-25T06:17:45.842 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T06:17:45.842 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T06:17:45.843 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T06:17:45.843 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T06:17:45.843 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T06:17:45.843 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-01-25T06:17:45.843 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T06:17:45.844 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T06:17:45.844 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T06:17:45.844 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T06:17:46.256 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-01-25T06:17:46.257 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-01-25T06:17:46.258 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-01-25T06:17:46.368 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-01-25T06:17:46.400 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-01-25T06:17:46.467 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T06:17:46.468 INFO:tasks.ceph:role: osd.6 2023-01-25T06:17:46.468 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com 2023-01-25T06:17:46.468 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-01-25T06:17:46.543 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T06:17:46.543 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T06:17:46.543 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T06:17:46.543 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T06:17:46.544 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T06:17:46.544 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-01-25T06:17:46.544 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T06:17:46.544 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T06:17:46.544 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T06:17:46.545 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T06:17:46.993 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-01-25T06:17:46.995 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-01-25T06:17:46.996 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-01-25T06:17:47.136 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-01-25T06:17:47.170 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-01-25T06:17:47.239 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T06:17:47.239 INFO:tasks.ceph:role: osd.7 2023-01-25T06:17:47.240 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com 2023-01-25T06:17:47.240 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-01-25T06:17:47.315 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T06:17:47.316 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T06:17:47.316 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T06:17:47.316 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T06:17:47.316 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T06:17:47.317 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-01-25T06:17:47.317 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T06:17:47.317 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T06:17:47.317 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T06:17:47.317 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T06:17:47.762 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-01-25T06:17:47.764 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-01-25T06:17:47.765 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-01-25T06:17:47.940 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-01-25T06:17:47.979 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:17:48.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:48.085+0000 7fc47ef8f5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-01-25T06:17:48.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:48.085+0000 7fc47ef8f5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-01-25T06:17:48.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:48.094+0000 7fc47ef8f5c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-25T06:17:48.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:48.094+0000 7fc47ef8f5c0 -1 journal FileJournal::_open_file : zeroing journal 2023-01-25T06:17:48.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:48.306+0000 7fc47ef8f5c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-25T06:17:48.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:48.306+0000 7fc47ef8f5c0 -1 journal do_read_entry(4096): bad header magic 2023-01-25T06:17:48.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:48.306+0000 7fc47ef8f5c0 -1 journal do_read_entry(4096): bad header magic 2023-01-25T06:17:48.332 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-01-25T06:17:48.368 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:17:48.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:48.453+0000 7f4714cdd5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-01-25T06:17:48.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:48.453+0000 7f4714cdd5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-01-25T06:17:48.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:48.458+0000 7f4714cdd5c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-25T06:17:48.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:48.458+0000 7f4714cdd5c0 -1 journal FileJournal::_open_file : zeroing journal 2023-01-25T06:17:48.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:48.589+0000 7f4714cdd5c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-25T06:17:48.590 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:48.589+0000 7f4714cdd5c0 -1 journal do_read_entry(4096): bad header magic 2023-01-25T06:17:48.590 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:48.589+0000 7f4714cdd5c0 -1 journal do_read_entry(4096): bad header magic 2023-01-25T06:17:48.599 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-01-25T06:17:48.625 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:17:48.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:48.709+0000 7f2168f5d5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-01-25T06:17:48.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:48.709+0000 7f2168f5d5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-01-25T06:17:48.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:48.714+0000 7f2168f5d5c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-25T06:17:48.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:48.714+0000 7f2168f5d5c0 -1 journal FileJournal::_open_file : zeroing journal 2023-01-25T06:17:48.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:48.849+0000 7f2168f5d5c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-25T06:17:48.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:48.851+0000 7f2168f5d5c0 -1 journal do_read_entry(4096): bad header magic 2023-01-25T06:17:48.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:48.851+0000 7f2168f5d5c0 -1 journal do_read_entry(4096): bad header magic 2023-01-25T06:17:48.862 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-01-25T06:17:48.888 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:17:48.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:48.972+0000 7fcb00cb75c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-01-25T06:17:48.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:48.972+0000 7fcb00cb75c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-01-25T06:17:48.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:48.979+0000 7fcb00cb75c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-25T06:17:48.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:48.979+0000 7fcb00cb75c0 -1 journal FileJournal::_open_file : zeroing journal 2023-01-25T06:17:49.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:49.113+0000 7fcb00cb75c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-25T06:17:49.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:49.115+0000 7fcb00cb75c0 -1 journal do_read_entry(4096): bad header magic 2023-01-25T06:17:49.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-01-25T06:17:49.115+0000 7fcb00cb75c0 -1 journal do_read_entry(4096): bad header magic 2023-01-25T06:17:49.126 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-01-25T06:17:49.152 INFO:tasks.ceph:Reading keys from all nodes... 2023-01-25T06:17:49.152 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-01-25T06:17:49.153 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-01-25T06:17:49.184 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-01-25T06:17:49.184 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-01-25T06:17:49.254 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-01-25T06:17:49.254 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-01-25T06:17:49.322 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-01-25T06:17:49.322 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-01-25T06:17:49.389 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-01-25T06:17:49.389 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-01-25T06:17:49.457 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-01-25T06:17:49.457 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-01-25T06:17:49.484 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-01-25T06:17:49.485 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-01-25T06:17:49.551 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-01-25T06:17:49.552 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-01-25T06:17:49.618 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-01-25T06:17:49.618 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-01-25T06:17:49.683 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-01-25T06:17:49.684 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-01-25T06:17:49.750 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-01-25T06:17:49.750 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-01-25T06:17:49.768 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-01-25T06:17:49.769 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-01-25T06:17:49.806 INFO:tasks.ceph:Adding keys to all mons... 2023-01-25T06:17:49.807 DEBUG:teuthology.orchestra.run.smithi088:> sudo tee -a /etc/ceph/ceph.keyring 2023-01-25T06:17:49.810 DEBUG:teuthology.orchestra.run.smithi089:> sudo tee -a /etc/ceph/ceph.keyring 2023-01-25T06:17:49.849 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.y] 2023-01-25T06:17:49.850 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCEydBjf1hLIxAAjrn23B26vB2hiiQcbpvZJA== 2023-01-25T06:17:49.850 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.0] 2023-01-25T06:17:49.850 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCHydBjIG8vMxAAk6hiO3EOkzGi5LTUv8guXA== 2023-01-25T06:17:49.850 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.1] 2023-01-25T06:17:49.850 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCIydBjfVdWDRAAW6UX/Jke+Y2wAqmzsv/UsA== 2023-01-25T06:17:49.851 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.2] 2023-01-25T06:17:49.851 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCIydBjk/9qHhAAYbYqjDtM2kloZ9IeBxvXpQ== 2023-01-25T06:17:49.851 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.3] 2023-01-25T06:17:49.851 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCIydBjvvbhLRAAtuPj7zjZCYY/9iTmGZ85hw== 2023-01-25T06:17:49.851 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.x] 2023-01-25T06:17:49.851 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCEydBj7tdAJxAAs1bNeJxz2xo02al6hsg1kA== 2023-01-25T06:17:49.852 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.4] 2023-01-25T06:17:49.852 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCMydBjP5AoBRAAoigxN5YwS1gnnVOlbEV4qQ== 2023-01-25T06:17:49.852 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.5] 2023-01-25T06:17:49.852 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCMydBjGD8OGxAALv8353Gwl9SskSrmeKAOmA== 2023-01-25T06:17:49.852 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.6] 2023-01-25T06:17:49.853 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCMydBjsUxRKhAAiQNlouKbC6Pd0YEaJmj9Sg== 2023-01-25T06:17:49.853 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.7] 2023-01-25T06:17:49.853 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCMydBjGlcCOhAA4x8OawnrX/7VWBGgNniLNQ== 2023-01-25T06:17:49.853 INFO:teuthology.orchestra.run.smithi088.stdout:[client.0] 2023-01-25T06:17:49.853 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCEydBjQEILKhAA1g+Yme33iCuaxE+hfdwX5Q== 2023-01-25T06:17:49.854 INFO:teuthology.orchestra.run.smithi088.stdout:[client.1] 2023-01-25T06:17:49.854 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCEydBj9XB5LRAAEzloxPI1TVmLjVn5ERGljw== 2023-01-25T06:17:49.871 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.y] 2023-01-25T06:17:49.871 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCEydBjf1hLIxAAjrn23B26vB2hiiQcbpvZJA== 2023-01-25T06:17:49.871 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.0] 2023-01-25T06:17:49.872 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCHydBjIG8vMxAAk6hiO3EOkzGi5LTUv8guXA== 2023-01-25T06:17:49.872 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.1] 2023-01-25T06:17:49.872 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCIydBjfVdWDRAAW6UX/Jke+Y2wAqmzsv/UsA== 2023-01-25T06:17:49.872 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.2] 2023-01-25T06:17:49.872 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCIydBjk/9qHhAAYbYqjDtM2kloZ9IeBxvXpQ== 2023-01-25T06:17:49.873 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.3] 2023-01-25T06:17:49.873 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCIydBjvvbhLRAAtuPj7zjZCYY/9iTmGZ85hw== 2023-01-25T06:17:49.873 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.x] 2023-01-25T06:17:49.873 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCEydBj7tdAJxAAs1bNeJxz2xo02al6hsg1kA== 2023-01-25T06:17:49.873 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.4] 2023-01-25T06:17:49.873 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCMydBjP5AoBRAAoigxN5YwS1gnnVOlbEV4qQ== 2023-01-25T06:17:49.874 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.5] 2023-01-25T06:17:49.874 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCMydBjGD8OGxAALv8353Gwl9SskSrmeKAOmA== 2023-01-25T06:17:49.874 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.6] 2023-01-25T06:17:49.874 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCMydBjsUxRKhAAiQNlouKbC6Pd0YEaJmj9Sg== 2023-01-25T06:17:49.874 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.7] 2023-01-25T06:17:49.875 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCMydBjGlcCOhAA4x8OawnrX/7VWBGgNniLNQ== 2023-01-25T06:17:49.875 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2023-01-25T06:17:49.875 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCEydBjQEILKhAA1g+Yme33iCuaxE+hfdwX5Q== 2023-01-25T06:17:49.875 INFO:teuthology.orchestra.run.smithi089.stdout:[client.1] 2023-01-25T06:17:49.875 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCEydBj9XB5LRAAEzloxPI1TVmLjVn5ERGljw== 2023-01-25T06:17:49.876 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T06:17:49.898 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T06:17:49.968 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:17:49.971 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:17:50.023 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:17:50.025 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:17:50.077 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:17:50.080 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:17:50.133 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:17:50.135 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:17:50.187 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T06:17:50.190 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T06:17:50.243 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:17:50.246 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:17:50.298 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:17:50.301 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:17:50.353 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:17:50.355 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:17:50.407 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:17:50.410 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:17:50.461 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T06:17:50.464 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T06:17:50.519 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T06:17:50.521 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T06:17:50.576 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-01-25T06:17:50.576 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-01-25T06:17:50.602 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-25T06:17:50.699 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-01-25T06:17:50.726 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-01-25T06:17:50.791 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-25T06:17:50.887 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-01-25T06:17:50.913 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-01-25T06:17:50.941 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-25T06:17:51.038 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-01-25T06:17:51.064 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:17:51.066 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:17:51.120 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-01-25T06:17:51.121 INFO:tasks.ceph.mon.a:Restarting daemon 2023-01-25T06:17:51.121 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-01-25T06:17:51.124 INFO:tasks.ceph.mon.a:Started 2023-01-25T06:17:51.124 INFO:tasks.ceph.mon.c:Restarting daemon 2023-01-25T06:17:51.124 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-01-25T06:17:51.126 INFO:tasks.ceph.mon.c:Started 2023-01-25T06:17:51.126 INFO:tasks.ceph.mon.b:Restarting daemon 2023-01-25T06:17:51.127 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-01-25T06:17:51.162 INFO:tasks.ceph.mon.b:Started 2023-01-25T06:17:51.163 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-01-25T06:17:51.163 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-01-25T06:17:51.163 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-01-25T06:17:51.167 INFO:tasks.ceph.mgr.y:Started 2023-01-25T06:17:51.168 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-01-25T06:17:51.168 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-01-25T06:17:51.170 INFO:tasks.ceph.mgr.x:Started 2023-01-25T06:17:51.170 INFO:tasks.ceph:Setting crush tunables to default 2023-01-25T06:17:51.170 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd crush tunables default 2023-01-25T06:17:56.557 INFO:teuthology.orchestra.run.smithi088.stderr:adjusted tunables profile to default 2023-01-25T06:17:56.568 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-01-25T06:17:56.569 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-01-25T06:17:56.569 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-01-25T06:17:56.588 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-01-25T06:17:56.588+0000 7f742a6a8200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-01-25T06:17:56.596 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-01-25T06:17:56.596 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-01-25T06:17:56.651 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-01-25T06:17:56.651+0000 7f742a6a8200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-01-25T06:17:56.663 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-01-25T06:17:56.663 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-01-25T06:17:56.724 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-01-25T06:17:56.723+0000 7f742a6a8200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-01-25T06:17:56.728 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-01-25T06:17:56.729 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-01-25T06:17:56.795 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-01-25T06:17:56.795 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-01-25T06:17:56.800 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-01-25T06:17:56.800+0000 7f742a6a8200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-01-25T06:17:56.821 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-01-25T06:17:56.821 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-01-25T06:17:56.887 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-01-25T06:17:56.888 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-01-25T06:17:56.946 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-01-25T06:17:56.945+0000 7f742a6a8200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-01-25T06:17:56.954 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-01-25T06:17:56.954 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-01-25T06:17:57.020 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 50c76f73-423e-4d2e-81c4-97fa55941951 0 2023-01-25T06:17:57.273 INFO:teuthology.orchestra.run.smithi089.stdout:0 2023-01-25T06:17:57.285 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new e5963c22-5fed-4985-b71c-714f9b07878d 1 2023-01-25T06:17:57.290 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-01-25T06:17:57.290+0000 7f742a6a8200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-01-25T06:17:57.362 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-01-25T06:17:57.360+0000 7fa0f9239200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-01-25T06:17:57.368 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-01-25T06:17:57.367+0000 7f742a6a8200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-01-25T06:17:57.426 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-01-25T06:17:57.424+0000 7fa0f9239200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-01-25T06:17:57.492 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-01-25T06:17:57.491+0000 7f742a6a8200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-01-25T06:17:57.500 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-01-25T06:17:57.501 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-01-25T06:17:57.499+0000 7fa0f9239200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-01-25T06:17:57.513 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new f1837a84-aeca-4c85-b79d-acc12a94d495 2 2023-01-25T06:17:57.576 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-01-25T06:17:57.575+0000 7f742a6a8200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-01-25T06:17:57.578 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-01-25T06:17:57.576+0000 7fa0f9239200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-01-25T06:17:57.717 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-01-25T06:17:57.716+0000 7fa0f9239200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-01-25T06:17:57.770 INFO:teuthology.orchestra.run.smithi089.stdout:2 2023-01-25T06:17:57.783 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 6b0008f5-1f8d-44d9-bb08-c04972e98070 3 2023-01-25T06:17:58.014 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-01-25T06:17:58.013+0000 7f742a6a8200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-01-25T06:17:58.041 INFO:teuthology.orchestra.run.smithi089.stdout:3 2023-01-25T06:17:58.041 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-01-25T06:17:58.039+0000 7fa0f9239200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-01-25T06:17:58.053 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new b7aaff7f-32a6-44da-851f-ceb299c19b9f 4 2023-01-25T06:17:58.114 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-01-25T06:17:58.112+0000 7fa0f9239200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-01-25T06:17:58.231 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-01-25T06:17:58.230+0000 7fa0f9239200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-01-25T06:17:58.273 INFO:teuthology.orchestra.run.smithi089.stdout:4 2023-01-25T06:17:58.286 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 87dc1a6f-b6fa-4f4d-9084-31a4c1d080c6 5 2023-01-25T06:17:58.311 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-01-25T06:17:58.310+0000 7fa0f9239200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-01-25T06:17:58.533 INFO:teuthology.orchestra.run.smithi089.stdout:5 2023-01-25T06:17:58.546 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new be2d1751-e27c-4ec7-b661-9ea9780e8d73 6 2023-01-25T06:17:58.588 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-01-25T06:17:58.587+0000 7f742a6a8200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-01-25T06:17:58.748 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-01-25T06:17:58.747+0000 7f742a6a8200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-01-25T06:17:58.748 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-01-25T06:17:58.748+0000 7fa0f9239200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-01-25T06:17:58.765 INFO:teuthology.orchestra.run.smithi089.stdout:6 2023-01-25T06:17:58.778 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new da543c8b-5575-4724-b959-bbdaf8934a17 7 2023-01-25T06:17:59.032 INFO:teuthology.orchestra.run.smithi089.stdout:7 2023-01-25T06:17:59.045 INFO:tasks.ceph.osd.0:Restarting daemon 2023-01-25T06:17:59.045 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-01-25T06:17:59.048 INFO:tasks.ceph.osd.0:Started 2023-01-25T06:17:59.048 INFO:tasks.ceph.osd.1:Restarting daemon 2023-01-25T06:17:59.049 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-01-25T06:17:59.051 INFO:tasks.ceph.osd.1:Started 2023-01-25T06:17:59.051 INFO:tasks.ceph.osd.2:Restarting daemon 2023-01-25T06:17:59.051 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-01-25T06:17:59.053 INFO:tasks.ceph.osd.2:Started 2023-01-25T06:17:59.054 INFO:tasks.ceph.osd.3:Restarting daemon 2023-01-25T06:17:59.054 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-01-25T06:17:59.056 INFO:tasks.ceph.osd.3:Started 2023-01-25T06:17:59.057 INFO:tasks.ceph.osd.4:Restarting daemon 2023-01-25T06:17:59.057 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-01-25T06:17:59.059 INFO:tasks.ceph.osd.4:Started 2023-01-25T06:17:59.059 INFO:tasks.ceph.osd.5:Restarting daemon 2023-01-25T06:17:59.060 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-01-25T06:17:59.062 INFO:tasks.ceph.osd.5:Started 2023-01-25T06:17:59.062 INFO:tasks.ceph.osd.6:Restarting daemon 2023-01-25T06:17:59.063 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-01-25T06:17:59.064 INFO:tasks.ceph.osd.6:Started 2023-01-25T06:17:59.065 INFO:tasks.ceph.osd.7:Restarting daemon 2023-01-25T06:17:59.065 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-01-25T06:17:59.067 INFO:tasks.ceph.osd.7:Started 2023-01-25T06:17:59.068 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-25T06:17:59.147 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-01-25T06:17:59.146+0000 7f43609565c0 -1 Falling back to public interface 2023-01-25T06:17:59.149 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-01-25T06:17:59.148+0000 7fe7fbbab5c0 -1 Falling back to public interface 2023-01-25T06:17:59.149 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-01-25T06:17:59.148+0000 7f65172175c0 -1 Falling back to public interface 2023-01-25T06:17:59.150 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-01-25T06:17:59.149+0000 7fe6163db5c0 -1 Falling back to public interface 2023-01-25T06:17:59.152 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-01-25T06:17:59.151+0000 7f1f0ab2c5c0 -1 Falling back to public interface 2023-01-25T06:17:59.157 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-01-25T06:17:59.157+0000 7f52299545c0 -1 Falling back to public interface 2023-01-25T06:17:59.165 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-01-25T06:17:59.164+0000 7f65172175c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-25T06:17:59.165 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-01-25T06:17:59.164+0000 7f65172175c0 -1 journal do_read_entry(8192): bad header magic 2023-01-25T06:17:59.165 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-01-25T06:17:59.164+0000 7f65172175c0 -1 journal do_read_entry(8192): bad header magic 2023-01-25T06:17:59.167 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-01-25T06:17:59.166+0000 7fe6163db5c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-25T06:17:59.167 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-01-25T06:17:59.166+0000 7fe6163db5c0 -1 journal do_read_entry(8192): bad header magic 2023-01-25T06:17:59.167 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-01-25T06:17:59.166+0000 7fe6163db5c0 -1 journal do_read_entry(8192): bad header magic 2023-01-25T06:17:59.168 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-01-25T06:17:59.167+0000 7f1b7291d5c0 -1 Falling back to public interface 2023-01-25T06:17:59.170 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-01-25T06:17:59.169+0000 7fe7fbbab5c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-25T06:17:59.170 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-01-25T06:17:59.169+0000 7fe7fbbab5c0 -1 journal do_read_entry(8192): bad header magic 2023-01-25T06:17:59.170 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-01-25T06:17:59.169+0000 7fe7fbbab5c0 -1 journal do_read_entry(8192): bad header magic 2023-01-25T06:17:59.171 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-01-25T06:17:59.170+0000 7f2832b895c0 -1 Falling back to public interface 2023-01-25T06:17:59.173 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-01-25T06:17:59.172+0000 7f1f0ab2c5c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-25T06:17:59.173 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-01-25T06:17:59.172+0000 7f65172175c0 -1 osd.5 0 log_to_monitors true 2023-01-25T06:17:59.174 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-01-25T06:17:59.174+0000 7fe6163db5c0 -1 osd.6 0 log_to_monitors true 2023-01-25T06:17:59.178 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-01-25T06:17:59.172+0000 7f1f0ab2c5c0 -1 journal do_read_entry(8192): bad header magic 2023-01-25T06:17:59.178 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-01-25T06:17:59.172+0000 7f1f0ab2c5c0 -1 journal do_read_entry(8192): bad header magic 2023-01-25T06:17:59.180 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-01-25T06:17:59.179+0000 7fe7fbbab5c0 -1 osd.0 0 log_to_monitors true 2023-01-25T06:17:59.180 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-01-25T06:17:59.180+0000 7f1f0ab2c5c0 -1 osd.1 0 log_to_monitors true 2023-01-25T06:17:59.186 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-01-25T06:17:59.185+0000 7f1b7291d5c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-25T06:17:59.186 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-01-25T06:17:59.185+0000 7f1b7291d5c0 -1 journal do_read_entry(8192): bad header magic 2023-01-25T06:17:59.186 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-01-25T06:17:59.185+0000 7f1b7291d5c0 -1 journal do_read_entry(8192): bad header magic 2023-01-25T06:17:59.192 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-01-25T06:17:59.191+0000 7f1b7291d5c0 -1 osd.4 0 log_to_monitors true 2023-01-25T06:17:59.194 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-01-25T06:17:59.193+0000 7f2832b895c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-25T06:17:59.194 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-01-25T06:17:59.193+0000 7f2832b895c0 -1 journal do_read_entry(8192): bad header magic 2023-01-25T06:17:59.194 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-01-25T06:17:59.193+0000 7f2832b895c0 -1 journal do_read_entry(8192): bad header magic 2023-01-25T06:17:59.196 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-01-25T06:17:59.196+0000 7f43609565c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-25T06:17:59.200 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-01-25T06:17:59.196+0000 7f43609565c0 -1 journal do_read_entry(8192): bad header magic 2023-01-25T06:17:59.200 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-01-25T06:17:59.196+0000 7f43609565c0 -1 journal do_read_entry(8192): bad header magic 2023-01-25T06:17:59.201 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-01-25T06:17:59.199+0000 7f2832b895c0 -1 osd.7 0 log_to_monitors true 2023-01-25T06:17:59.203 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-01-25T06:17:59.203+0000 7f52299545c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-25T06:17:59.204 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-01-25T06:17:59.203+0000 7f52299545c0 -1 journal do_read_entry(8192): bad header magic 2023-01-25T06:17:59.204 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-01-25T06:17:59.203+0000 7f52299545c0 -1 journal do_read_entry(8192): bad header magic 2023-01-25T06:17:59.206 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-01-25T06:17:59.205+0000 7f43609565c0 -1 osd.3 0 log_to_monitors true 2023-01-25T06:17:59.214 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-01-25T06:17:59.213+0000 7f52299545c0 -1 osd.2 0 log_to_monitors true 2023-01-25T06:17:59.323 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:17:59.323 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":10,"fsid":"46db3fbd-f892-4dd1-b3a1-5ebdf38661bb","created":"2023-01-25T06:17:56.455100+0000","modified":"2023-01-25T06:17:59.028535+0000","last_up_change":"0.000000","last_in_change":"2023-01-25T06:17:59.028535+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"50c76f73-423e-4d2e-81c4-97fa55941951","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e5963c22-5fed-4985-b71c-714f9b07878d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f1837a84-aeca-4c85-b79d-acc12a94d495","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6b0008f5-1f8d-44d9-bb08-c04972e98070","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b7aaff7f-32a6-44da-851f-ceb299c19b9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"87dc1a6f-b6fa-4f4d-9084-31a4c1d080c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"be2d1751-e27c-4ec7-b661-9ea9780e8d73","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"da543c8b-5575-4724-b959-bbdaf8934a17","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T06:17:59.335 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-01-25T06:17:59.336 INFO:tasks.ceph:Waiting for OSDs to come up 2023-01-25T06:17:59.358 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-01-25T06:17:59.357+0000 7fa0f9239200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-01-25T06:17:59.475 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-01-25T06:17:59.474+0000 7f742a6a8200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-01-25T06:17:59.511 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-01-25T06:17:59.510+0000 7fa0f9239200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-01-25T06:17:59.550 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-01-25T06:17:59.549+0000 7f742a6a8200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-01-25T06:17:59.686 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-01-25T06:17:59.686+0000 7f742a6a8200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-01-25T06:17:59.843 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-01-25T06:17:59.842+0000 7f742a6a8200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-01-25T06:17:59.972 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-01-25T06:17:59.971+0000 7f742a6a8200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-01-25T06:18:00.141 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-01-25T06:18:00.177 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-01-25T06:18:00.176+0000 7fa0f9239200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-01-25T06:18:00.255 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-01-25T06:18:00.255+0000 7fa0f9239200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-01-25T06:18:00.321 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-01-25T06:18:00.320+0000 7f742a6a8200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-01-25T06:18:00.333 INFO:teuthology.misc.health.smithi088.stdout: 2023-01-25T06:18:00.333 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":11,"fsid":"46db3fbd-f892-4dd1-b3a1-5ebdf38661bb","created":"2023-01-25T06:17:56.455100+0000","modified":"2023-01-25T06:18:00.029540+0000","last_up_change":"0.000000","last_in_change":"2023-01-25T06:17:59.028535+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"50c76f73-423e-4d2e-81c4-97fa55941951","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e5963c22-5fed-4985-b71c-714f9b07878d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f1837a84-aeca-4c85-b79d-acc12a94d495","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6b0008f5-1f8d-44d9-bb08-c04972e98070","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b7aaff7f-32a6-44da-851f-ceb299c19b9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"87dc1a6f-b6fa-4f4d-9084-31a4c1d080c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"be2d1751-e27c-4ec7-b661-9ea9780e8d73","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"da543c8b-5575-4724-b959-bbdaf8934a17","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T06:18:00.344 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-01-25T06:18:00.397 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-01-25T06:18:00.397+0000 7fa0f9239200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-01-25T06:18:00.471 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-01-25T06:18:00.471+0000 7f742a6a8200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-01-25T06:18:00.553 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-01-25T06:18:00.553+0000 7fa0f9239200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-01-25T06:18:00.584 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-01-25T06:18:00.583+0000 7f742a6a8200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-01-25T06:18:00.681 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-01-25T06:18:00.681+0000 7fa0f9239200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-01-25T06:18:00.728 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-01-25T06:18:00.728+0000 7f742a6a8200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-01-25T06:18:00.826 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-01-25T06:18:00.825+0000 7f742a6a8200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-01-25T06:18:01.029 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-01-25T06:18:01.029+0000 7fa0f9239200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-01-25T06:18:01.036 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-01-25T06:18:01.035+0000 7f1b66cd5700 -1 osd.4 0 waiting for initial osdmap 2023-01-25T06:18:01.036 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-01-25T06:18:01.036+0000 7fe7eff63700 -1 osd.0 0 waiting for initial osdmap 2023-01-25T06:18:01.037 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-01-25T06:18:01.035+0000 7f650b5cf700 -1 osd.5 0 waiting for initial osdmap 2023-01-25T06:18:01.037 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-01-25T06:18:01.036+0000 7f521dd0c700 -1 osd.2 0 waiting for initial osdmap 2023-01-25T06:18:01.037 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-01-25T06:18:01.036+0000 7f1b5589d700 -1 osd.4 0 handle_osd_map injecting map crc failure 2023-01-25T06:18:01.038 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-01-25T06:18:01.036+0000 7f4354d0e700 -1 osd.3 0 waiting for initial osdmap 2023-01-25T06:18:01.040 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-01-25T06:18:01.039+0000 7f1efeee4700 -1 osd.1 0 waiting for initial osdmap 2023-01-25T06:18:01.040 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-01-25T06:18:01.039+0000 7f2826f41700 -1 osd.7 0 waiting for initial osdmap 2023-01-25T06:18:01.040 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-01-25T06:18:01.039+0000 7fe60a793700 -1 osd.6 0 waiting for initial osdmap 2023-01-25T06:18:01.041 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-01-25T06:18:01.039+0000 7f2815b09700 -1 osd.7 0 handle_osd_map injecting map crc failure 2023-01-25T06:18:01.041 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-01-25T06:18:01.040+0000 7f64fa197700 -1 osd.5 0 handle_osd_map injecting map crc failure 2023-01-25T06:18:01.041 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-01-25T06:18:01.040+0000 7fe5f935b700 -1 osd.6 0 handle_osd_map injecting map crc failure 2023-01-25T06:18:01.042 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-01-25T06:18:01.040+0000 7f1eedaac700 -1 osd.1 0 handle_osd_map injecting map crc failure 2023-01-25T06:18:01.042 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-01-25T06:18:01.040+0000 7f43438d6700 -1 osd.3 0 handle_osd_map injecting map crc failure 2023-01-25T06:18:01.043 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-01-25T06:18:01.041+0000 7f520c8d4700 -1 osd.2 0 handle_osd_map injecting map crc failure 2023-01-25T06:18:01.043 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-01-25T06:18:01.041+0000 7fe7deb2b700 -1 osd.0 0 handle_osd_map injecting map crc failure 2023-01-25T06:18:01.050 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-01-25T06:18:01.050+0000 7f1b628b7700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T06:18:01.052 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-01-25T06:18:01.051+0000 7f52198ee700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T06:18:01.053 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-01-25T06:18:01.052+0000 7f65071b1700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T06:18:01.053 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-01-25T06:18:01.053+0000 7fe606375700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T06:18:01.055 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-01-25T06:18:01.054+0000 7f2822b23700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T06:18:01.059 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-01-25T06:18:01.058+0000 7f43508f0700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T06:18:01.059 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-01-25T06:18:01.058+0000 7fe7ebb45700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T06:18:01.060 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-01-25T06:18:01.060+0000 7f1efaac6700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T06:18:01.178 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-01-25T06:18:01.177+0000 7f742a6a8200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-01-25T06:18:01.183 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-01-25T06:18:01.183+0000 7fa0f9239200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-01-25T06:18:01.297 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-01-25T06:18:01.297+0000 7fa0f9239200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-01-25T06:18:01.441 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-01-25T06:18:01.440+0000 7fa0f9239200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-01-25T06:18:01.538 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-01-25T06:18:01.537+0000 7fa0f9239200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-01-25T06:18:01.752 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-01-25T06:18:01.751+0000 7f742a6a8200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-01-25T06:18:01.894 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-01-25T06:18:01.893+0000 7fa0f9239200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-01-25T06:18:02.474 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-01-25T06:18:02.474+0000 7fa0f9239200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-01-25T06:18:02.767 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-01-25T06:18:02.766+0000 7f73e2a29700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-01-25T06:18:02.768 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-01-25T06:18:02.768+0000 7f73e2a29700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-01-25T06:18:05.066 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-01-25T06:18:05.065+0000 7f1eedaac700 -1 osd.1 15 handle_osd_map injecting map crc failure 2023-01-25T06:18:06.078 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-01-25T06:18:06.077+0000 7fe5f935b700 -1 osd.6 16 handle_osd_map injecting map crc failure 2023-01-25T06:18:07.150 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-01-25T06:18:07.310 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-01-25T06:18:07.310+0000 7f43418d2700 -1 osd.3 16 handle_osd_map injecting map crc failure 2023-01-25T06:18:07.468 INFO:teuthology.misc.health.smithi088.stdout: 2023-01-25T06:18:07.468 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":17,"fsid":"46db3fbd-f892-4dd1-b3a1-5ebdf38661bb","created":"2023-01-25T06:17:56.455100+0000","modified":"2023-01-25T06:18:06.066064+0000","last_up_change":"2023-01-25T06:18:02.036668+0000","last_in_change":"2023-01-25T06:17:59.028535+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-01-25T06:18:03.804447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"50c76f73-423e-4d2e-81c4-97fa55941951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":88620},{"type":"v1","addr":"172.21.15.88:6809","nonce":88620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":88620},{"type":"v1","addr":"172.21.15.88:6811","nonce":88620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":88620},{"type":"v1","addr":"172.21.15.88:6815","nonce":88620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":88620},{"type":"v1","addr":"172.21.15.88:6813","nonce":88620}]},"public_addr":"172.21.15.88:6809/88620","cluster_addr":"172.21.15.88:6811/88620","heartbeat_back_addr":"172.21.15.88:6815/88620","heartbeat_front_addr":"172.21.15.88:6813/88620","state":["exists","up"]},{"osd":1,"uuid":"e5963c22-5fed-4985-b71c-714f9b07878d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":88622},{"type":"v1","addr":"172.21.15.88:6817","nonce":88622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":88622},{"type":"v1","addr":"172.21.15.88:6819","nonce":88622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":88622},{"type":"v1","addr":"172.21.15.88:6823","nonce":88622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":88622},{"type":"v1","addr":"172.21.15.88:6821","nonce":88622}]},"public_addr":"172.21.15.88:6817/88622","cluster_addr":"172.21.15.88:6819/88622","heartbeat_back_addr":"172.21.15.88:6823/88622","heartbeat_front_addr":"172.21.15.88:6821/88622","state":["exists","up"]},{"osd":2,"uuid":"f1837a84-aeca-4c85-b79d-acc12a94d495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":88624},{"type":"v1","addr":"172.21.15.88:6825","nonce":88624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":88624},{"type":"v1","addr":"172.21.15.88:6827","nonce":88624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":88624},{"type":"v1","addr":"172.21.15.88:6831","nonce":88624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":88624},{"type":"v1","addr":"172.21.15.88:6829","nonce":88624}]},"public_addr":"172.21.15.88:6825/88624","cluster_addr":"172.21.15.88:6827/88624","heartbeat_back_addr":"172.21.15.88:6831/88624","heartbeat_front_addr":"172.21.15.88:6829/88624","state":["exists","up"]},{"osd":3,"uuid":"6b0008f5-1f8d-44d9-bb08-c04972e98070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":88623},{"type":"v1","addr":"172.21.15.88:6801","nonce":88623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":88623},{"type":"v1","addr":"172.21.15.88:6803","nonce":88623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":88623},{"type":"v1","addr":"172.21.15.88:6807","nonce":88623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":88623},{"type":"v1","addr":"172.21.15.88:6805","nonce":88623}]},"public_addr":"172.21.15.88:6801/88623","cluster_addr":"172.21.15.88:6803/88623","heartbeat_back_addr":"172.21.15.88:6807/88623","heartbeat_front_addr":"172.21.15.88:6805/88623","state":["exists","up"]},{"osd":4,"uuid":"b7aaff7f-32a6-44da-851f-ceb299c19b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":88695},{"type":"v1","addr":"172.21.15.89:6817","nonce":88695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":88695},{"type":"v1","addr":"172.21.15.89:6819","nonce":88695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":88695},{"type":"v1","addr":"172.21.15.89:6824","nonce":88695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":88695},{"type":"v1","addr":"172.21.15.89:6821","nonce":88695}]},"public_addr":"172.21.15.89:6817/88695","cluster_addr":"172.21.15.89:6819/88695","heartbeat_back_addr":"172.21.15.89:6824/88695","heartbeat_front_addr":"172.21.15.89:6821/88695","state":["exists","up"]},{"osd":5,"uuid":"87dc1a6f-b6fa-4f4d-9084-31a4c1d080c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":88693},{"type":"v1","addr":"172.21.15.89:6801","nonce":88693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":88693},{"type":"v1","addr":"172.21.15.89:6803","nonce":88693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":88693},{"type":"v1","addr":"172.21.15.89:6807","nonce":88693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":88693},{"type":"v1","addr":"172.21.15.89:6805","nonce":88693}]},"public_addr":"172.21.15.89:6801/88693","cluster_addr":"172.21.15.89:6803/88693","heartbeat_back_addr":"172.21.15.89:6807/88693","heartbeat_front_addr":"172.21.15.89:6805/88693","state":["exists","up"]},{"osd":6,"uuid":"be2d1751-e27c-4ec7-b661-9ea9780e8d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":88694},{"type":"v1","addr":"172.21.15.89:6809","nonce":88694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":88694},{"type":"v1","addr":"172.21.15.89:6811","nonce":88694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":88694},{"type":"v1","addr":"172.21.15.89:6815","nonce":88694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":88694},{"type":"v1","addr":"172.21.15.89:6813","nonce":88694}]},"public_addr":"172.21.15.89:6809/88694","cluster_addr":"172.21.15.89:6811/88694","heartbeat_back_addr":"172.21.15.89:6815/88694","heartbeat_front_addr":"172.21.15.89:6813/88694","state":["exists","up"]},{"osd":7,"uuid":"da543c8b-5575-4724-b959-bbdaf8934a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":88714},{"type":"v1","addr":"172.21.15.89:6825","nonce":88714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":88714},{"type":"v1","addr":"172.21.15.89:6827","nonce":88714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":88714},{"type":"v1","addr":"172.21.15.89:6831","nonce":88714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":88714},{"type":"v1","addr":"172.21.15.89:6829","nonce":88714}]},"public_addr":"172.21.15.89:6825/88714","cluster_addr":"172.21.15.89:6827/88714","heartbeat_back_addr":"172.21.15.89:6831/88714","heartbeat_front_addr":"172.21.15.89:6829/88714","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:18:00.214216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:18:00.136720+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:18:00.206608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:18:00.202795+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:18:00.160740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:18:00.167446+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:18:00.221673+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:18:00.250728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T06:18:07.481 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-01-25T06:18:07.481 INFO:tasks.ceph:Creating RBD pool 2023-01-25T06:18:07.482 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd pool create rbd 8 2023-01-25T06:18:08.090 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'rbd' created 2023-01-25T06:18:08.101 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-01-25T06:18:09.097 INFO:teuthology.orchestra.run.smithi088.stderr:enabled application 'rbd' on pool 'rbd' 2023-01-25T06:18:09.110 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-01-25T06:18:09.111 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-01-25T06:18:09.111 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-01-25T06:18:09.111 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-01-25T06:18:09.112 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-01-25T06:18:09.486 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:18:09.498 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":4,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":88077},{"type":"v1","addr":"172.21.15.89:6833","nonce":88077}]},"active_addr":"172.21.15.89:6833/88077","active_change":"2023-01-25T06:18:01.754098+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4116,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":3160551935}]},{"addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":3289782847}]},{"addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":2730414598}]}]}} 2023-01-25T06:18:09.504 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-01-25T06:18:09.504 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-01-25T06:18:09.504 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-25T06:18:09.827 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:18:09.827 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":19,"fsid":"46db3fbd-f892-4dd1-b3a1-5ebdf38661bb","created":"2023-01-25T06:17:56.455100+0000","modified":"2023-01-25T06:18:09.080870+0000","last_up_change":"2023-01-25T06:18:02.036668+0000","last_in_change":"2023-01-25T06:17:59.028535+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-01-25T06:18:03.804447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-01-25T06:18:07.812670+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"50c76f73-423e-4d2e-81c4-97fa55941951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":88620},{"type":"v1","addr":"172.21.15.88:6809","nonce":88620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":88620},{"type":"v1","addr":"172.21.15.88:6811","nonce":88620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":88620},{"type":"v1","addr":"172.21.15.88:6815","nonce":88620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":88620},{"type":"v1","addr":"172.21.15.88:6813","nonce":88620}]},"public_addr":"172.21.15.88:6809/88620","cluster_addr":"172.21.15.88:6811/88620","heartbeat_back_addr":"172.21.15.88:6815/88620","heartbeat_front_addr":"172.21.15.88:6813/88620","state":["exists","up"]},{"osd":1,"uuid":"e5963c22-5fed-4985-b71c-714f9b07878d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":88622},{"type":"v1","addr":"172.21.15.88:6817","nonce":88622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":88622},{"type":"v1","addr":"172.21.15.88:6819","nonce":88622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":88622},{"type":"v1","addr":"172.21.15.88:6823","nonce":88622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":88622},{"type":"v1","addr":"172.21.15.88:6821","nonce":88622}]},"public_addr":"172.21.15.88:6817/88622","cluster_addr":"172.21.15.88:6819/88622","heartbeat_back_addr":"172.21.15.88:6823/88622","heartbeat_front_addr":"172.21.15.88:6821/88622","state":["exists","up"]},{"osd":2,"uuid":"f1837a84-aeca-4c85-b79d-acc12a94d495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":88624},{"type":"v1","addr":"172.21.15.88:6825","nonce":88624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":88624},{"type":"v1","addr":"172.21.15.88:6827","nonce":88624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":88624},{"type":"v1","addr":"172.21.15.88:6831","nonce":88624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":88624},{"type":"v1","addr":"172.21.15.88:6829","nonce":88624}]},"public_addr":"172.21.15.88:6825/88624","cluster_addr":"172.21.15.88:6827/88624","heartbeat_back_addr":"172.21.15.88:6831/88624","heartbeat_front_addr":"172.21.15.88:6829/88624","state":["exists","up"]},{"osd":3,"uuid":"6b0008f5-1f8d-44d9-bb08-c04972e98070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":88623},{"type":"v1","addr":"172.21.15.88:6801","nonce":88623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":88623},{"type":"v1","addr":"172.21.15.88:6803","nonce":88623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":88623},{"type":"v1","addr":"172.21.15.88:6807","nonce":88623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":88623},{"type":"v1","addr":"172.21.15.88:6805","nonce":88623}]},"public_addr":"172.21.15.88:6801/88623","cluster_addr":"172.21.15.88:6803/88623","heartbeat_back_addr":"172.21.15.88:6807/88623","heartbeat_front_addr":"172.21.15.88:6805/88623","state":["exists","up"]},{"osd":4,"uuid":"b7aaff7f-32a6-44da-851f-ceb299c19b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":88695},{"type":"v1","addr":"172.21.15.89:6817","nonce":88695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":88695},{"type":"v1","addr":"172.21.15.89:6819","nonce":88695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":88695},{"type":"v1","addr":"172.21.15.89:6824","nonce":88695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":88695},{"type":"v1","addr":"172.21.15.89:6821","nonce":88695}]},"public_addr":"172.21.15.89:6817/88695","cluster_addr":"172.21.15.89:6819/88695","heartbeat_back_addr":"172.21.15.89:6824/88695","heartbeat_front_addr":"172.21.15.89:6821/88695","state":["exists","up"]},{"osd":5,"uuid":"87dc1a6f-b6fa-4f4d-9084-31a4c1d080c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":88693},{"type":"v1","addr":"172.21.15.89:6801","nonce":88693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":88693},{"type":"v1","addr":"172.21.15.89:6803","nonce":88693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":88693},{"type":"v1","addr":"172.21.15.89:6807","nonce":88693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":88693},{"type":"v1","addr":"172.21.15.89:6805","nonce":88693}]},"public_addr":"172.21.15.89:6801/88693","cluster_addr":"172.21.15.89:6803/88693","heartbeat_back_addr":"172.21.15.89:6807/88693","heartbeat_front_addr":"172.21.15.89:6805/88693","state":["exists","up"]},{"osd":6,"uuid":"be2d1751-e27c-4ec7-b661-9ea9780e8d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":88694},{"type":"v1","addr":"172.21.15.89:6809","nonce":88694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":88694},{"type":"v1","addr":"172.21.15.89:6811","nonce":88694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":88694},{"type":"v1","addr":"172.21.15.89:6815","nonce":88694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":88694},{"type":"v1","addr":"172.21.15.89:6813","nonce":88694}]},"public_addr":"172.21.15.89:6809/88694","cluster_addr":"172.21.15.89:6811/88694","heartbeat_back_addr":"172.21.15.89:6815/88694","heartbeat_front_addr":"172.21.15.89:6813/88694","state":["exists","up"]},{"osd":7,"uuid":"da543c8b-5575-4724-b959-bbdaf8934a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":88714},{"type":"v1","addr":"172.21.15.89:6825","nonce":88714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":88714},{"type":"v1","addr":"172.21.15.89:6827","nonce":88714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":88714},{"type":"v1","addr":"172.21.15.89:6831","nonce":88714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":88714},{"type":"v1","addr":"172.21.15.89:6829","nonce":88714}]},"public_addr":"172.21.15.89:6825/88714","cluster_addr":"172.21.15.89:6827/88714","heartbeat_back_addr":"172.21.15.89:6831/88714","heartbeat_front_addr":"172.21.15.89:6829/88714","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:18:00.214216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:18:00.136720+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:18:00.206608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:18:00.202795+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:18:00.160740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:18:00.167446+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:18:00.221673+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:18:00.250728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T06:18:09.841 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-01-25T06:18:09.841 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-25T06:18:10.160 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:18:10.161 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"46db3fbd-f892-4dd1-b3a1-5ebdf38661bb","created":"2023-01-25T06:17:56.455100+0000","modified":"2023-01-25T06:18:10.089919+0000","last_up_change":"2023-01-25T06:18:02.036668+0000","last_in_change":"2023-01-25T06:17:59.028535+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-01-25T06:18:03.804447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-01-25T06:18:07.812670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"50c76f73-423e-4d2e-81c4-97fa55941951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":88620},{"type":"v1","addr":"172.21.15.88:6809","nonce":88620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":88620},{"type":"v1","addr":"172.21.15.88:6811","nonce":88620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":88620},{"type":"v1","addr":"172.21.15.88:6815","nonce":88620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":88620},{"type":"v1","addr":"172.21.15.88:6813","nonce":88620}]},"public_addr":"172.21.15.88:6809/88620","cluster_addr":"172.21.15.88:6811/88620","heartbeat_back_addr":"172.21.15.88:6815/88620","heartbeat_front_addr":"172.21.15.88:6813/88620","state":["exists","up"]},{"osd":1,"uuid":"e5963c22-5fed-4985-b71c-714f9b07878d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":88622},{"type":"v1","addr":"172.21.15.88:6817","nonce":88622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":88622},{"type":"v1","addr":"172.21.15.88:6819","nonce":88622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":88622},{"type":"v1","addr":"172.21.15.88:6823","nonce":88622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":88622},{"type":"v1","addr":"172.21.15.88:6821","nonce":88622}]},"public_addr":"172.21.15.88:6817/88622","cluster_addr":"172.21.15.88:6819/88622","heartbeat_back_addr":"172.21.15.88:6823/88622","heartbeat_front_addr":"172.21.15.88:6821/88622","state":["exists","up"]},{"osd":2,"uuid":"f1837a84-aeca-4c85-b79d-acc12a94d495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":88624},{"type":"v1","addr":"172.21.15.88:6825","nonce":88624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":88624},{"type":"v1","addr":"172.21.15.88:6827","nonce":88624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":88624},{"type":"v1","addr":"172.21.15.88:6831","nonce":88624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":88624},{"type":"v1","addr":"172.21.15.88:6829","nonce":88624}]},"public_addr":"172.21.15.88:6825/88624","cluster_addr":"172.21.15.88:6827/88624","heartbeat_back_addr":"172.21.15.88:6831/88624","heartbeat_front_addr":"172.21.15.88:6829/88624","state":["exists","up"]},{"osd":3,"uuid":"6b0008f5-1f8d-44d9-bb08-c04972e98070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":88623},{"type":"v1","addr":"172.21.15.88:6801","nonce":88623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":88623},{"type":"v1","addr":"172.21.15.88:6803","nonce":88623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":88623},{"type":"v1","addr":"172.21.15.88:6807","nonce":88623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":88623},{"type":"v1","addr":"172.21.15.88:6805","nonce":88623}]},"public_addr":"172.21.15.88:6801/88623","cluster_addr":"172.21.15.88:6803/88623","heartbeat_back_addr":"172.21.15.88:6807/88623","heartbeat_front_addr":"172.21.15.88:6805/88623","state":["exists","up"]},{"osd":4,"uuid":"b7aaff7f-32a6-44da-851f-ceb299c19b9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":88695},{"type":"v1","addr":"172.21.15.89:6817","nonce":88695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":88695},{"type":"v1","addr":"172.21.15.89:6819","nonce":88695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":88695},{"type":"v1","addr":"172.21.15.89:6824","nonce":88695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":88695},{"type":"v1","addr":"172.21.15.89:6821","nonce":88695}]},"public_addr":"172.21.15.89:6817/88695","cluster_addr":"172.21.15.89:6819/88695","heartbeat_back_addr":"172.21.15.89:6824/88695","heartbeat_front_addr":"172.21.15.89:6821/88695","state":["exists","up"]},{"osd":5,"uuid":"87dc1a6f-b6fa-4f4d-9084-31a4c1d080c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":88693},{"type":"v1","addr":"172.21.15.89:6801","nonce":88693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":88693},{"type":"v1","addr":"172.21.15.89:6803","nonce":88693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":88693},{"type":"v1","addr":"172.21.15.89:6807","nonce":88693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":88693},{"type":"v1","addr":"172.21.15.89:6805","nonce":88693}]},"public_addr":"172.21.15.89:6801/88693","cluster_addr":"172.21.15.89:6803/88693","heartbeat_back_addr":"172.21.15.89:6807/88693","heartbeat_front_addr":"172.21.15.89:6805/88693","state":["exists","up"]},{"osd":6,"uuid":"be2d1751-e27c-4ec7-b661-9ea9780e8d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":88694},{"type":"v1","addr":"172.21.15.89:6809","nonce":88694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":88694},{"type":"v1","addr":"172.21.15.89:6811","nonce":88694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":88694},{"type":"v1","addr":"172.21.15.89:6815","nonce":88694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":88694},{"type":"v1","addr":"172.21.15.89:6813","nonce":88694}]},"public_addr":"172.21.15.89:6809/88694","cluster_addr":"172.21.15.89:6811/88694","heartbeat_back_addr":"172.21.15.89:6815/88694","heartbeat_front_addr":"172.21.15.89:6813/88694","state":["exists","up"]},{"osd":7,"uuid":"da543c8b-5575-4724-b959-bbdaf8934a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":88714},{"type":"v1","addr":"172.21.15.89:6825","nonce":88714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":88714},{"type":"v1","addr":"172.21.15.89:6827","nonce":88714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":88714},{"type":"v1","addr":"172.21.15.89:6831","nonce":88714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":88714},{"type":"v1","addr":"172.21.15.89:6829","nonce":88714}]},"public_addr":"172.21.15.89:6825/88714","cluster_addr":"172.21.15.89:6827/88714","heartbeat_back_addr":"172.21.15.89:6831/88714","heartbeat_front_addr":"172.21.15.89:6829/88714","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:18:00.214216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:18:00.136720+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:18:00.206608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:18:00.202795+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:18:00.160740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:18:00.167446+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:18:00.221673+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:18:00.250728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T06:18:10.175 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-01-25T06:18:10.175 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-01-25T06:18:10.176 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-01-25T06:18:10.176 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-01-25T06:18:10.177 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-01-25T06:18:10.177 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-01-25T06:18:10.178 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-01-25T06:18:10.178 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-01-25T06:18:10.456 INFO:teuthology.orchestra.run.smithi088.stdout:55834574851 2023-01-25T06:18:10.457 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-01-25T06:18:10.458 INFO:teuthology.orchestra.run.smithi088.stdout:55834574851 2023-01-25T06:18:10.459 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-01-25T06:18:10.460 INFO:teuthology.orchestra.run.smithi088.stdout:55834574851 2023-01-25T06:18:10.460 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-01-25T06:18:10.461 INFO:teuthology.orchestra.run.smithi088.stdout:55834574851 2023-01-25T06:18:10.462 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-01-25T06:18:10.465 INFO:teuthology.orchestra.run.smithi088.stdout:55834574851 2023-01-25T06:18:10.466 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-01-25T06:18:10.472 INFO:teuthology.orchestra.run.smithi088.stdout:55834574851 2023-01-25T06:18:10.472 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-01-25T06:18:10.493 INFO:teuthology.orchestra.run.smithi088.stdout:55834574851 2023-01-25T06:18:10.494 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-01-25T06:18:10.556 INFO:teuthology.orchestra.run.smithi088.stdout:55834574851 2023-01-25T06:18:10.557 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-01-25T06:18:11.065 INFO:teuthology.orchestra.run.smithi088.stdout:55834574850 2023-01-25T06:18:11.066 INFO:teuthology.orchestra.run.smithi088.stdout:55834574850 2023-01-25T06:18:11.069 INFO:teuthology.orchestra.run.smithi088.stdout:55834574850 2023-01-25T06:18:11.075 INFO:teuthology.orchestra.run.smithi088.stdout:55834574850 2023-01-25T06:18:11.086 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.2 2023-01-25T06:18:11.099 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.7 2023-01-25T06:18:11.108 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.4 2023-01-25T06:18:11.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.0 2023-01-25T06:18:11.112 INFO:teuthology.orchestra.run.smithi088.stdout:55834574850 2023-01-25T06:18:11.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.3 2023-01-25T06:18:11.156 INFO:teuthology.orchestra.run.smithi088.stdout:55834574850 2023-01-25T06:18:11.169 INFO:teuthology.orchestra.run.smithi088.stdout:55834574850 2023-01-25T06:18:11.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.5 2023-01-25T06:18:11.180 INFO:teuthology.orchestra.run.smithi088.stdout:55834574850 2023-01-25T06:18:11.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.6 2023-01-25T06:18:11.195 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.1 2023-01-25T06:18:12.087 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-01-25T06:18:12.101 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-01-25T06:18:12.108 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-01-25T06:18:12.112 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-01-25T06:18:12.128 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-01-25T06:18:12.179 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-01-25T06:18:12.187 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-01-25T06:18:12.195 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-01-25T06:18:12.650 INFO:teuthology.orchestra.run.smithi088.stdout:55834574851 2023-01-25T06:18:12.677 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.2 2023-01-25T06:18:12.677 DEBUG:teuthology.parallel:result is None 2023-01-25T06:18:12.708 INFO:teuthology.orchestra.run.smithi088.stdout:55834574851 2023-01-25T06:18:12.726 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.3 2023-01-25T06:18:12.727 DEBUG:teuthology.parallel:result is None 2023-01-25T06:18:12.739 INFO:teuthology.orchestra.run.smithi088.stdout:55834574851 2023-01-25T06:18:12.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.7 2023-01-25T06:18:12.760 DEBUG:teuthology.parallel:result is None 2023-01-25T06:18:12.760 INFO:teuthology.orchestra.run.smithi088.stdout:55834574851 2023-01-25T06:18:12.762 INFO:teuthology.orchestra.run.smithi088.stdout:55834574851 2023-01-25T06:18:12.769 INFO:teuthology.orchestra.run.smithi088.stdout:55834574851 2023-01-25T06:18:12.780 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.5 2023-01-25T06:18:12.781 DEBUG:teuthology.parallel:result is None 2023-01-25T06:18:12.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.0 2023-01-25T06:18:12.788 DEBUG:teuthology.parallel:result is None 2023-01-25T06:18:12.789 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.4 2023-01-25T06:18:12.789 DEBUG:teuthology.parallel:result is None 2023-01-25T06:18:12.825 INFO:teuthology.orchestra.run.smithi088.stdout:55834574851 2023-01-25T06:18:12.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.1 2023-01-25T06:18:12.840 DEBUG:teuthology.parallel:result is None 2023-01-25T06:18:12.848 INFO:teuthology.orchestra.run.smithi088.stdout:55834574851 2023-01-25T06:18:12.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.6 2023-01-25T06:18:12.862 DEBUG:teuthology.parallel:result is None 2023-01-25T06:18:12.862 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-01-25T06:18:12.862 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-25T06:18:13.217 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:18:13.220 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-01-25T06:18:13.231 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2023-01-25T06:18:11.763696+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":80,"num_write":107,"num_write_kb":1242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71,"ondisk_log_size":71,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6368864,"kb_used_data":743226968,"kb_used_omap":430,"kb_used_meta":0,"kb_avail":743226176,"statfs":{"total":767585320960,"available":761063604224,"internally_reserved":811008,"allocated":761064415232,"data_stored":761064415232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":440698,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":6,"commit_latency_ns":1000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":131072,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":42,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.681695"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.095868+0000","last_change":"2023-01-25T06:18:09.096008+0000","last_active":"2023-01-25T06:18:10.095868+0000","last_peered":"2023-01-25T06:18:10.095868+0000","last_clean":"2023-01-25T06:18:10.095868+0000","last_became_active":"2023-01-25T06:18:09.095703+0000","last_became_peered":"2023-01-25T06:18:09.095703+0000","last_unstale":"2023-01-25T06:18:10.095868+0000","last_undegraded":"2023-01-25T06:18:10.095868+0000","last_fullsized":"2023-01-25T06:18:10.095868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:09.029617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-25T06:18:09.192523+0000","last_change":"2023-01-25T06:18:09.192398+0000","last_active":"2023-01-25T06:18:09.192523+0000","last_peered":"2023-01-25T06:18:09.192523+0000","last_clean":"2023-01-25T06:18:09.192523+0000","last_became_active":"2023-01-25T06:18:09.192167+0000","last_became_peered":"2023-01-25T06:18:09.192167+0000","last_unstale":"2023-01-25T06:18:09.192523+0000","last_undegraded":"2023-01-25T06:18:09.192523+0000","last_fullsized":"2023-01-25T06:18:09.192523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:29.637849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.095849+0000","last_change":"2023-01-25T06:18:09.096052+0000","last_active":"2023-01-25T06:18:10.095849+0000","last_peered":"2023-01-25T06:18:10.095849+0000","last_clean":"2023-01-25T06:18:10.095849+0000","last_became_active":"2023-01-25T06:18:09.095705+0000","last_became_peered":"2023-01-25T06:18:09.095705+0000","last_unstale":"2023-01-25T06:18:10.095849+0000","last_undegraded":"2023-01-25T06:18:10.095849+0000","last_fullsized":"2023-01-25T06:18:10.095849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:27.550939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.196118+0000","last_change":"2023-01-25T06:18:09.195187+0000","last_active":"2023-01-25T06:18:10.196118+0000","last_peered":"2023-01-25T06:18:10.196118+0000","last_clean":"2023-01-25T06:18:10.196118+0000","last_became_active":"2023-01-25T06:18:09.194933+0000","last_became_peered":"2023-01-25T06:18:09.194933+0000","last_unstale":"2023-01-25T06:18:10.196118+0000","last_undegraded":"2023-01-25T06:18:10.196118+0000","last_fullsized":"2023-01-25T06:18:10.196118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:31.842185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'71","reported_seq":109,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.426610+0000","last_change":"2023-01-25T06:18:05.071730+0000","last_active":"2023-01-25T06:18:10.426610+0000","last_peered":"2023-01-25T06:18:10.426610+0000","last_clean":"2023-01-25T06:18:10.426610+0000","last_became_active":"2023-01-25T06:18:05.070895+0000","last_became_peered":"2023-01-25T06:18:05.070895+0000","last_unstale":"2023-01-25T06:18:10.426610+0000","last_undegraded":"2023-01-25T06:18:10.426610+0000","last_fullsized":"2023-01-25T06:18:10.426610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:04.056332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:04.056332+0000","last_clean_scrub_stamp":"2023-01-25T06:18:04.056332+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:31.922194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":80,"num_write":107,"num_write_kb":1242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.095866+0000","last_change":"2023-01-25T06:18:09.286333+0000","last_active":"2023-01-25T06:18:10.095866+0000","last_peered":"2023-01-25T06:18:10.095866+0000","last_clean":"2023-01-25T06:18:10.095866+0000","last_became_active":"2023-01-25T06:18:09.286073+0000","last_became_peered":"2023-01-25T06:18:09.286073+0000","last_unstale":"2023-01-25T06:18:10.095866+0000","last_undegraded":"2023-01-25T06:18:10.095866+0000","last_fullsized":"2023-01-25T06:18:10.095866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:36.650208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-25T06:18:09.196030+0000","last_change":"2023-01-25T06:18:09.195818+0000","last_active":"2023-01-25T06:18:09.196030+0000","last_peered":"2023-01-25T06:18:09.196030+0000","last_clean":"2023-01-25T06:18:09.196030+0000","last_became_active":"2023-01-25T06:18:09.195507+0000","last_became_peered":"2023-01-25T06:18:09.195507+0000","last_unstale":"2023-01-25T06:18:09.196030+0000","last_undegraded":"2023-01-25T06:18:09.196030+0000","last_fullsized":"2023-01-25T06:18:09.196030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:33.689848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.195953+0000","last_change":"2023-01-25T06:18:09.195127+0000","last_active":"2023-01-25T06:18:10.195953+0000","last_peered":"2023-01-25T06:18:10.195953+0000","last_clean":"2023-01-25T06:18:10.195953+0000","last_became_active":"2023-01-25T06:18:09.194868+0000","last_became_peered":"2023-01-25T06:18:09.194868+0000","last_unstale":"2023-01-25T06:18:10.195953+0000","last_undegraded":"2023-01-25T06:18:10.195953+0000","last_fullsized":"2023-01-25T06:18:10.195953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:08.447170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.209525+0000","last_change":"2023-01-25T06:18:09.194247+0000","last_active":"2023-01-25T06:18:10.209525+0000","last_peered":"2023-01-25T06:18:10.209525+0000","last_clean":"2023-01-25T06:18:10.209525+0000","last_became_active":"2023-01-25T06:18:09.193980+0000","last_became_peered":"2023-01-25T06:18:09.193980+0000","last_unstale":"2023-01-25T06:18:10.209525+0000","last_undegraded":"2023-01-25T06:18:10.209525+0000","last_fullsized":"2023-01-25T06:18:10.209525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:09.401275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":80,"num_write":107,"num_write_kb":1242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71,"ondisk_log_size":71,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795812,"kb_used_data":92903576,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":92903568,"statfs":{"total":95948165120,"available":95133253632,"internally_reserved":8192,"allocated":95133261824,"data_stored":95133261824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38347,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":28.050999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795876,"kb_used_data":92903528,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903504,"statfs":{"total":95948165120,"available":95133188096,"internally_reserved":24576,"allocated":95133212672,"data_stored":95133212672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43711,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796896,"kb_used_data":92902824,"kb_used_omap":76,"kb_used_meta":0,"kb_avail":92902484,"statfs":{"total":95948165120,"available":95132143616,"internally_reserved":348160,"allocated":95132491776,"data_stored":95132491776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":77893,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":27.164999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795808,"kb_used_data":92903580,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903572,"statfs":{"total":95948165120,"available":95133257728,"internally_reserved":8192,"allocated":95133265920,"data_stored":95133265920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43597,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795868,"kb_used_data":92903536,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":92903512,"statfs":{"total":95948165120,"available":95133196288,"internally_reserved":24576,"allocated":95133220864,"data_stored":95133220864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38341,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795872,"kb_used_data":92903524,"kb_used_omap":58,"kb_used_meta":0,"kb_avail":92903508,"statfs":{"total":95948165120,"available":95133192192,"internally_reserved":16384,"allocated":95133208576,"data_stored":95133208576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59775,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795808,"kb_used_data":92903580,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903572,"statfs":{"total":95948165120,"available":95133257728,"internally_reserved":8192,"allocated":95133265920,"data_stored":95133265920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43679,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796924,"kb_used_data":92902820,"kb_used_omap":93,"kb_used_meta":0,"kb_avail":92902456,"statfs":{"total":95948165120,"available":95132114944,"internally_reserved":372736,"allocated":95132487680,"data_stored":95132487680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":95355,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]}],"pool_statfs":[]}} 2023-01-25T06:18:13.233 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-25T06:18:13.544 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:18:13.546 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-01-25T06:18:13.557 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2023-01-25T06:18:11.763696+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":80,"num_write":107,"num_write_kb":1242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71,"ondisk_log_size":71,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6368864,"kb_used_data":743226968,"kb_used_omap":430,"kb_used_meta":0,"kb_avail":743226176,"statfs":{"total":767585320960,"available":761063604224,"internally_reserved":811008,"allocated":761064415232,"data_stored":761064415232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":440698,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":6,"commit_latency_ns":1000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":131072,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":42,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.681695"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.095868+0000","last_change":"2023-01-25T06:18:09.096008+0000","last_active":"2023-01-25T06:18:10.095868+0000","last_peered":"2023-01-25T06:18:10.095868+0000","last_clean":"2023-01-25T06:18:10.095868+0000","last_became_active":"2023-01-25T06:18:09.095703+0000","last_became_peered":"2023-01-25T06:18:09.095703+0000","last_unstale":"2023-01-25T06:18:10.095868+0000","last_undegraded":"2023-01-25T06:18:10.095868+0000","last_fullsized":"2023-01-25T06:18:10.095868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:09.029617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-25T06:18:09.192523+0000","last_change":"2023-01-25T06:18:09.192398+0000","last_active":"2023-01-25T06:18:09.192523+0000","last_peered":"2023-01-25T06:18:09.192523+0000","last_clean":"2023-01-25T06:18:09.192523+0000","last_became_active":"2023-01-25T06:18:09.192167+0000","last_became_peered":"2023-01-25T06:18:09.192167+0000","last_unstale":"2023-01-25T06:18:09.192523+0000","last_undegraded":"2023-01-25T06:18:09.192523+0000","last_fullsized":"2023-01-25T06:18:09.192523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:29.637849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.095849+0000","last_change":"2023-01-25T06:18:09.096052+0000","last_active":"2023-01-25T06:18:10.095849+0000","last_peered":"2023-01-25T06:18:10.095849+0000","last_clean":"2023-01-25T06:18:10.095849+0000","last_became_active":"2023-01-25T06:18:09.095705+0000","last_became_peered":"2023-01-25T06:18:09.095705+0000","last_unstale":"2023-01-25T06:18:10.095849+0000","last_undegraded":"2023-01-25T06:18:10.095849+0000","last_fullsized":"2023-01-25T06:18:10.095849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:27.550939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.196118+0000","last_change":"2023-01-25T06:18:09.195187+0000","last_active":"2023-01-25T06:18:10.196118+0000","last_peered":"2023-01-25T06:18:10.196118+0000","last_clean":"2023-01-25T06:18:10.196118+0000","last_became_active":"2023-01-25T06:18:09.194933+0000","last_became_peered":"2023-01-25T06:18:09.194933+0000","last_unstale":"2023-01-25T06:18:10.196118+0000","last_undegraded":"2023-01-25T06:18:10.196118+0000","last_fullsized":"2023-01-25T06:18:10.196118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:31.842185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'71","reported_seq":109,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.426610+0000","last_change":"2023-01-25T06:18:05.071730+0000","last_active":"2023-01-25T06:18:10.426610+0000","last_peered":"2023-01-25T06:18:10.426610+0000","last_clean":"2023-01-25T06:18:10.426610+0000","last_became_active":"2023-01-25T06:18:05.070895+0000","last_became_peered":"2023-01-25T06:18:05.070895+0000","last_unstale":"2023-01-25T06:18:10.426610+0000","last_undegraded":"2023-01-25T06:18:10.426610+0000","last_fullsized":"2023-01-25T06:18:10.426610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:04.056332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:04.056332+0000","last_clean_scrub_stamp":"2023-01-25T06:18:04.056332+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:31.922194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":80,"num_write":107,"num_write_kb":1242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.095866+0000","last_change":"2023-01-25T06:18:09.286333+0000","last_active":"2023-01-25T06:18:10.095866+0000","last_peered":"2023-01-25T06:18:10.095866+0000","last_clean":"2023-01-25T06:18:10.095866+0000","last_became_active":"2023-01-25T06:18:09.286073+0000","last_became_peered":"2023-01-25T06:18:09.286073+0000","last_unstale":"2023-01-25T06:18:10.095866+0000","last_undegraded":"2023-01-25T06:18:10.095866+0000","last_fullsized":"2023-01-25T06:18:10.095866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:36.650208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-25T06:18:09.196030+0000","last_change":"2023-01-25T06:18:09.195818+0000","last_active":"2023-01-25T06:18:09.196030+0000","last_peered":"2023-01-25T06:18:09.196030+0000","last_clean":"2023-01-25T06:18:09.196030+0000","last_became_active":"2023-01-25T06:18:09.195507+0000","last_became_peered":"2023-01-25T06:18:09.195507+0000","last_unstale":"2023-01-25T06:18:09.196030+0000","last_undegraded":"2023-01-25T06:18:09.196030+0000","last_fullsized":"2023-01-25T06:18:09.196030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:33.689848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.195953+0000","last_change":"2023-01-25T06:18:09.195127+0000","last_active":"2023-01-25T06:18:10.195953+0000","last_peered":"2023-01-25T06:18:10.195953+0000","last_clean":"2023-01-25T06:18:10.195953+0000","last_became_active":"2023-01-25T06:18:09.194868+0000","last_became_peered":"2023-01-25T06:18:09.194868+0000","last_unstale":"2023-01-25T06:18:10.195953+0000","last_undegraded":"2023-01-25T06:18:10.195953+0000","last_fullsized":"2023-01-25T06:18:10.195953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:08.447170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.209525+0000","last_change":"2023-01-25T06:18:09.194247+0000","last_active":"2023-01-25T06:18:10.209525+0000","last_peered":"2023-01-25T06:18:10.209525+0000","last_clean":"2023-01-25T06:18:10.209525+0000","last_became_active":"2023-01-25T06:18:09.193980+0000","last_became_peered":"2023-01-25T06:18:09.193980+0000","last_unstale":"2023-01-25T06:18:10.209525+0000","last_undegraded":"2023-01-25T06:18:10.209525+0000","last_fullsized":"2023-01-25T06:18:10.209525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:09.401275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":80,"num_write":107,"num_write_kb":1242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71,"ondisk_log_size":71,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795812,"kb_used_data":92903576,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":92903568,"statfs":{"total":95948165120,"available":95133253632,"internally_reserved":8192,"allocated":95133261824,"data_stored":95133261824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38347,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":28.050999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795876,"kb_used_data":92903528,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903504,"statfs":{"total":95948165120,"available":95133188096,"internally_reserved":24576,"allocated":95133212672,"data_stored":95133212672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43711,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796896,"kb_used_data":92902824,"kb_used_omap":76,"kb_used_meta":0,"kb_avail":92902484,"statfs":{"total":95948165120,"available":95132143616,"internally_reserved":348160,"allocated":95132491776,"data_stored":95132491776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":77893,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":27.164999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795808,"kb_used_data":92903580,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903572,"statfs":{"total":95948165120,"available":95133257728,"internally_reserved":8192,"allocated":95133265920,"data_stored":95133265920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43597,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795868,"kb_used_data":92903536,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":92903512,"statfs":{"total":95948165120,"available":95133196288,"internally_reserved":24576,"allocated":95133220864,"data_stored":95133220864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38341,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795872,"kb_used_data":92903524,"kb_used_omap":58,"kb_used_meta":0,"kb_avail":92903508,"statfs":{"total":95948165120,"available":95133192192,"internally_reserved":16384,"allocated":95133208576,"data_stored":95133208576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59775,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795808,"kb_used_data":92903580,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903572,"statfs":{"total":95948165120,"available":95133257728,"internally_reserved":8192,"allocated":95133265920,"data_stored":95133265920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43679,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796924,"kb_used_data":92902820,"kb_used_omap":93,"kb_used_meta":0,"kb_avail":92902456,"statfs":{"total":95948165120,"available":95132114944,"internally_reserved":372736,"allocated":95132487680,"data_stored":95132487680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":95355,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]}],"pool_statfs":[]}} 2023-01-25T06:18:13.559 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-01-25T06:18:13.559 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-01-25T06:18:13.559 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-01-25T06:18:13.560 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-01-25T06:18:13.911 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:18:13.911 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-01-25T06:18:13.925 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-01-25T06:18:13.925 INFO:teuthology.run_tasks:Running task exec... 2023-01-25T06:18:13.935 INFO:teuthology.task.exec:Executing custom commands... 2023-01-25T06:18:13.935 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi088.front.sepia.ceph.com 2023-01-25T06:18:13.936 DEBUG:teuthology.orchestra.run.smithi088:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'while ! ceph balancer status ; do sleep 1 ; done' 2023-01-25T06:18:14.246 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-01-25T06:18:14.246 INFO:teuthology.orchestra.run.smithi088.stdout: "active": true, 2023-01-25T06:18:14.246 INFO:teuthology.orchestra.run.smithi088.stdout: "last_optimize_duration": "0:00:00.000808", 2023-01-25T06:18:14.246 INFO:teuthology.orchestra.run.smithi088.stdout: "last_optimize_started": "Wed Jan 25 06:18:01 2023", 2023-01-25T06:18:14.247 INFO:teuthology.orchestra.run.smithi088.stdout: "mode": "upmap", 2023-01-25T06:18:14.247 INFO:teuthology.orchestra.run.smithi088.stdout: "no_optimization_needed": false, 2023-01-25T06:18:14.247 INFO:teuthology.orchestra.run.smithi088.stdout: "optimize_result": "No pools available", 2023-01-25T06:18:14.247 INFO:teuthology.orchestra.run.smithi088.stdout: "plans": [] 2023-01-25T06:18:14.247 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-01-25T06:18:14.260 DEBUG:teuthology.orchestra.run.smithi088:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph balancer mode crush-compat' 2023-01-25T06:18:15.258 DEBUG:teuthology.orchestra.run.smithi088:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph balancer on' 2023-01-25T06:18:15.584 INFO:teuthology.run_tasks:Running task thrashosds... 2023-01-25T06:18:15.598 INFO:tasks.thrashosds:config is {'chance_pgnum_grow': 0.25, 'chance_pgnum_shrink': 0.25, 'chance_pgpnum_fix': 0.25, 'chance_test_map_discontinuity': 2, 'timeout': 1800, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2023-01-25T06:18:15.599 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-yuri2-testing-2023-01-23-0928'}, 'ceph': {'conf': {'global': {'mon election default strategy': 1, 'ms type': 'async', 'osd debug inject dispatch delay duration': 0.1, 'osd debug inject dispatch delay probability': 0.1, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'osd': {'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd backoff on degraded': True, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd inject bad map crc probability': 0.1, 'osd map cache size': 1, 'osd max backfills': 6, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'filestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub during recovery': False, 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd sloppy crc': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', 'but it is still running', 'objects unfound and apparently lost', 'osd_map_cache_size', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'must scrub before tier agent can activate'], 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'osd objectstore': 'filestore', 'osd sloppy crc': True}}, 'filestore': True, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'workunit': {'branch': 'wip-yuri2-testing-2023-01-23-0928', 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a'}} 2023-01-25T06:18:15.599 INFO:tasks.thrashosds:config is {'chance_pgnum_grow': 0.25, 'chance_pgnum_shrink': 0.25, 'chance_pgpnum_fix': 0.25, 'chance_test_map_discontinuity': 2, 'timeout': 1800, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2023-01-25T06:18:15.599 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2023-01-25T06:18:15.928 INFO:tasks.thrashosds:Beginning thrashosds... 2023-01-25T06:18:15.929 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-01-25T06:18:15.929 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-25T06:18:16.244 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:18:16.246 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-01-25T06:18:16.258 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-01-25T06:18:15.764459+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6372056,"kb_used_data":743225696,"kb_used_omap":464,"kb_used_meta":0,"kb_avail":743222984,"statfs":{"total":767585320960,"available":761060335616,"internally_reserved":2777088,"allocated":761063112704,"data_stored":761063112704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":475875,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":2,"commit_latency_ns":1000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":262160,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":47,"num_write":80,"num_write_kb":1566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.673819"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.095868+0000","last_change":"2023-01-25T06:18:09.096008+0000","last_active":"2023-01-25T06:18:10.095868+0000","last_peered":"2023-01-25T06:18:10.095868+0000","last_clean":"2023-01-25T06:18:10.095868+0000","last_became_active":"2023-01-25T06:18:09.095703+0000","last_became_peered":"2023-01-25T06:18:09.095703+0000","last_unstale":"2023-01-25T06:18:10.095868+0000","last_undegraded":"2023-01-25T06:18:10.095868+0000","last_fullsized":"2023-01-25T06:18:10.095868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:09.029617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.433074+0000","last_change":"2023-01-25T06:18:09.192398+0000","last_active":"2023-01-25T06:18:10.433074+0000","last_peered":"2023-01-25T06:18:10.433074+0000","last_clean":"2023-01-25T06:18:10.433074+0000","last_became_active":"2023-01-25T06:18:09.192167+0000","last_became_peered":"2023-01-25T06:18:09.192167+0000","last_unstale":"2023-01-25T06:18:10.433074+0000","last_undegraded":"2023-01-25T06:18:10.433074+0000","last_fullsized":"2023-01-25T06:18:10.433074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:29.637849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.095849+0000","last_change":"2023-01-25T06:18:09.096052+0000","last_active":"2023-01-25T06:18:10.095849+0000","last_peered":"2023-01-25T06:18:10.095849+0000","last_clean":"2023-01-25T06:18:10.095849+0000","last_became_active":"2023-01-25T06:18:09.095705+0000","last_became_peered":"2023-01-25T06:18:09.095705+0000","last_unstale":"2023-01-25T06:18:10.095849+0000","last_undegraded":"2023-01-25T06:18:10.095849+0000","last_fullsized":"2023-01-25T06:18:10.095849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:27.550939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.196118+0000","last_change":"2023-01-25T06:18:09.195187+0000","last_active":"2023-01-25T06:18:10.196118+0000","last_peered":"2023-01-25T06:18:10.196118+0000","last_clean":"2023-01-25T06:18:10.196118+0000","last_became_active":"2023-01-25T06:18:09.194933+0000","last_became_peered":"2023-01-25T06:18:09.194933+0000","last_unstale":"2023-01-25T06:18:10.196118+0000","last_undegraded":"2023-01-25T06:18:10.196118+0000","last_fullsized":"2023-01-25T06:18:10.196118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:31.842185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'105","reported_seq":148,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:12.396909+0000","last_change":"2023-01-25T06:18:05.071730+0000","last_active":"2023-01-25T06:18:12.396909+0000","last_peered":"2023-01-25T06:18:12.396909+0000","last_clean":"2023-01-25T06:18:12.396909+0000","last_became_active":"2023-01-25T06:18:05.070895+0000","last_became_peered":"2023-01-25T06:18:05.070895+0000","last_unstale":"2023-01-25T06:18:12.396909+0000","last_undegraded":"2023-01-25T06:18:12.396909+0000","last_fullsized":"2023-01-25T06:18:12.396909+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:04.056332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:04.056332+0000","last_clean_scrub_stamp":"2023-01-25T06:18:04.056332+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:31.922194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.095866+0000","last_change":"2023-01-25T06:18:09.286333+0000","last_active":"2023-01-25T06:18:10.095866+0000","last_peered":"2023-01-25T06:18:10.095866+0000","last_clean":"2023-01-25T06:18:10.095866+0000","last_became_active":"2023-01-25T06:18:09.286073+0000","last_became_peered":"2023-01-25T06:18:09.286073+0000","last_unstale":"2023-01-25T06:18:10.095866+0000","last_undegraded":"2023-01-25T06:18:10.095866+0000","last_fullsized":"2023-01-25T06:18:10.095866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:36.650208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.435021+0000","last_change":"2023-01-25T06:18:09.195818+0000","last_active":"2023-01-25T06:18:10.435021+0000","last_peered":"2023-01-25T06:18:10.435021+0000","last_clean":"2023-01-25T06:18:10.435021+0000","last_became_active":"2023-01-25T06:18:09.195507+0000","last_became_peered":"2023-01-25T06:18:09.195507+0000","last_unstale":"2023-01-25T06:18:10.435021+0000","last_undegraded":"2023-01-25T06:18:10.435021+0000","last_fullsized":"2023-01-25T06:18:10.435021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:33.689848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.195953+0000","last_change":"2023-01-25T06:18:09.195127+0000","last_active":"2023-01-25T06:18:10.195953+0000","last_peered":"2023-01-25T06:18:10.195953+0000","last_clean":"2023-01-25T06:18:10.195953+0000","last_became_active":"2023-01-25T06:18:09.194868+0000","last_became_peered":"2023-01-25T06:18:09.194868+0000","last_unstale":"2023-01-25T06:18:10.195953+0000","last_undegraded":"2023-01-25T06:18:10.195953+0000","last_fullsized":"2023-01-25T06:18:10.195953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:08.447170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.209525+0000","last_change":"2023-01-25T06:18:09.194247+0000","last_active":"2023-01-25T06:18:10.209525+0000","last_peered":"2023-01-25T06:18:10.209525+0000","last_clean":"2023-01-25T06:18:10.209525+0000","last_became_active":"2023-01-25T06:18:09.193980+0000","last_became_peered":"2023-01-25T06:18:09.193980+0000","last_unstale":"2023-01-25T06:18:10.209525+0000","last_undegraded":"2023-01-25T06:18:10.209525+0000","last_fullsized":"2023-01-25T06:18:10.209525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:09.401275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795872,"kb_used_data":92903524,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":92903508,"statfs":{"total":95948165120,"available":95133192192,"internally_reserved":16384,"allocated":95133208576,"data_stored":95133208576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38385,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":28.050999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795876,"kb_used_data":92903528,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903504,"statfs":{"total":95948165120,"available":95133188096,"internally_reserved":24576,"allocated":95133212672,"data_stored":95133212672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43711,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":798372,"kb_used_data":92902292,"kb_used_omap":93,"kb_used_meta":0,"kb_avail":92901008,"statfs":{"total":95948165120,"available":95130632192,"internally_reserved":1314816,"allocated":95131947008,"data_stored":95131947008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":95381,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":2,"commit_latency_ns":1000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":27.164999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795868,"kb_used_data":92903528,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903512,"statfs":{"total":95948165120,"available":95133196288,"internally_reserved":16384,"allocated":95133212672,"data_stored":95133212672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43635,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.276999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.128}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.035}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.1}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.976000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795928,"kb_used_data":92903484,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":92903452,"statfs":{"total":95948165120,"available":95133134848,"internally_reserved":32768,"allocated":95133167616,"data_stored":95133167616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38379,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795872,"kb_used_data":92903524,"kb_used_omap":58,"kb_used_meta":0,"kb_avail":92903508,"statfs":{"total":95948165120,"available":95133192192,"internally_reserved":16384,"allocated":95133208576,"data_stored":95133208576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59775,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795868,"kb_used_data":92903528,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903512,"statfs":{"total":95948165120,"available":95133196288,"internally_reserved":16384,"allocated":95133212672,"data_stored":95133212672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43717,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":798400,"kb_used_data":92902288,"kb_used_omap":110,"kb_used_meta":0,"kb_avail":92900980,"statfs":{"total":95948165120,"available":95130603520,"internally_reserved":1339392,"allocated":95131942912,"data_stored":95131942912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":112892,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]}],"pool_statfs":[]}} 2023-01-25T06:18:16.259 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-25T06:18:16.569 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T06:18:16.571 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-01-25T06:18:16.582 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-01-25T06:18:15.764459+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6372056,"kb_used_data":743225696,"kb_used_omap":464,"kb_used_meta":0,"kb_avail":743222984,"statfs":{"total":767585320960,"available":761060335616,"internally_reserved":2777088,"allocated":761063112704,"data_stored":761063112704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":475875,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":2,"commit_latency_ns":1000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":262160,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":47,"num_write":80,"num_write_kb":1566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.673819"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.095868+0000","last_change":"2023-01-25T06:18:09.096008+0000","last_active":"2023-01-25T06:18:10.095868+0000","last_peered":"2023-01-25T06:18:10.095868+0000","last_clean":"2023-01-25T06:18:10.095868+0000","last_became_active":"2023-01-25T06:18:09.095703+0000","last_became_peered":"2023-01-25T06:18:09.095703+0000","last_unstale":"2023-01-25T06:18:10.095868+0000","last_undegraded":"2023-01-25T06:18:10.095868+0000","last_fullsized":"2023-01-25T06:18:10.095868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:09.029617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.433074+0000","last_change":"2023-01-25T06:18:09.192398+0000","last_active":"2023-01-25T06:18:10.433074+0000","last_peered":"2023-01-25T06:18:10.433074+0000","last_clean":"2023-01-25T06:18:10.433074+0000","last_became_active":"2023-01-25T06:18:09.192167+0000","last_became_peered":"2023-01-25T06:18:09.192167+0000","last_unstale":"2023-01-25T06:18:10.433074+0000","last_undegraded":"2023-01-25T06:18:10.433074+0000","last_fullsized":"2023-01-25T06:18:10.433074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:29.637849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.095849+0000","last_change":"2023-01-25T06:18:09.096052+0000","last_active":"2023-01-25T06:18:10.095849+0000","last_peered":"2023-01-25T06:18:10.095849+0000","last_clean":"2023-01-25T06:18:10.095849+0000","last_became_active":"2023-01-25T06:18:09.095705+0000","last_became_peered":"2023-01-25T06:18:09.095705+0000","last_unstale":"2023-01-25T06:18:10.095849+0000","last_undegraded":"2023-01-25T06:18:10.095849+0000","last_fullsized":"2023-01-25T06:18:10.095849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:27.550939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.196118+0000","last_change":"2023-01-25T06:18:09.195187+0000","last_active":"2023-01-25T06:18:10.196118+0000","last_peered":"2023-01-25T06:18:10.196118+0000","last_clean":"2023-01-25T06:18:10.196118+0000","last_became_active":"2023-01-25T06:18:09.194933+0000","last_became_peered":"2023-01-25T06:18:09.194933+0000","last_unstale":"2023-01-25T06:18:10.196118+0000","last_undegraded":"2023-01-25T06:18:10.196118+0000","last_fullsized":"2023-01-25T06:18:10.196118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:31.842185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'105","reported_seq":148,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:12.396909+0000","last_change":"2023-01-25T06:18:05.071730+0000","last_active":"2023-01-25T06:18:12.396909+0000","last_peered":"2023-01-25T06:18:12.396909+0000","last_clean":"2023-01-25T06:18:12.396909+0000","last_became_active":"2023-01-25T06:18:05.070895+0000","last_became_peered":"2023-01-25T06:18:05.070895+0000","last_unstale":"2023-01-25T06:18:12.396909+0000","last_undegraded":"2023-01-25T06:18:12.396909+0000","last_fullsized":"2023-01-25T06:18:12.396909+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:04.056332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:04.056332+0000","last_clean_scrub_stamp":"2023-01-25T06:18:04.056332+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:31.922194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.095866+0000","last_change":"2023-01-25T06:18:09.286333+0000","last_active":"2023-01-25T06:18:10.095866+0000","last_peered":"2023-01-25T06:18:10.095866+0000","last_clean":"2023-01-25T06:18:10.095866+0000","last_became_active":"2023-01-25T06:18:09.286073+0000","last_became_peered":"2023-01-25T06:18:09.286073+0000","last_unstale":"2023-01-25T06:18:10.095866+0000","last_undegraded":"2023-01-25T06:18:10.095866+0000","last_fullsized":"2023-01-25T06:18:10.095866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:36.650208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.435021+0000","last_change":"2023-01-25T06:18:09.195818+0000","last_active":"2023-01-25T06:18:10.435021+0000","last_peered":"2023-01-25T06:18:10.435021+0000","last_clean":"2023-01-25T06:18:10.435021+0000","last_became_active":"2023-01-25T06:18:09.195507+0000","last_became_peered":"2023-01-25T06:18:09.195507+0000","last_unstale":"2023-01-25T06:18:10.435021+0000","last_undegraded":"2023-01-25T06:18:10.435021+0000","last_fullsized":"2023-01-25T06:18:10.435021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:33.689848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.195953+0000","last_change":"2023-01-25T06:18:09.195127+0000","last_active":"2023-01-25T06:18:10.195953+0000","last_peered":"2023-01-25T06:18:10.195953+0000","last_clean":"2023-01-25T06:18:10.195953+0000","last_became_active":"2023-01-25T06:18:09.194868+0000","last_became_peered":"2023-01-25T06:18:09.194868+0000","last_unstale":"2023-01-25T06:18:10.195953+0000","last_undegraded":"2023-01-25T06:18:10.195953+0000","last_fullsized":"2023-01-25T06:18:10.195953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:08.447170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-25T06:18:10.209525+0000","last_change":"2023-01-25T06:18:09.194247+0000","last_active":"2023-01-25T06:18:10.209525+0000","last_peered":"2023-01-25T06:18:10.209525+0000","last_clean":"2023-01-25T06:18:10.209525+0000","last_became_active":"2023-01-25T06:18:09.193980+0000","last_became_peered":"2023-01-25T06:18:09.193980+0000","last_unstale":"2023-01-25T06:18:10.209525+0000","last_undegraded":"2023-01-25T06:18:10.209525+0000","last_fullsized":"2023-01-25T06:18:10.209525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:18:08.074016+0000","last_clean_scrub_stamp":"2023-01-25T06:18:08.074016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T06:19:09.401275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795872,"kb_used_data":92903524,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":92903508,"statfs":{"total":95948165120,"available":95133192192,"internally_reserved":16384,"allocated":95133208576,"data_stored":95133208576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38385,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":28.050999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795876,"kb_used_data":92903528,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903504,"statfs":{"total":95948165120,"available":95133188096,"internally_reserved":24576,"allocated":95133212672,"data_stored":95133212672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43711,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":798372,"kb_used_data":92902292,"kb_used_omap":93,"kb_used_meta":0,"kb_avail":92901008,"statfs":{"total":95948165120,"available":95130632192,"internally_reserved":1314816,"allocated":95131947008,"data_stored":95131947008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":95381,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":2,"commit_latency_ns":1000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":27.164999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795868,"kb_used_data":92903528,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903512,"statfs":{"total":95948165120,"available":95133196288,"internally_reserved":16384,"allocated":95133212672,"data_stored":95133212672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43635,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.276999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.128}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.035}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.1}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.976000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795928,"kb_used_data":92903484,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":92903452,"statfs":{"total":95948165120,"available":95133134848,"internally_reserved":32768,"allocated":95133167616,"data_stored":95133167616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38379,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795872,"kb_used_data":92903524,"kb_used_omap":58,"kb_used_meta":0,"kb_avail":92903508,"statfs":{"total":95948165120,"available":95133192192,"internally_reserved":16384,"allocated":95133208576,"data_stored":95133208576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59775,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795868,"kb_used_data":92903528,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903512,"statfs":{"total":95948165120,"available":95133196288,"internally_reserved":16384,"allocated":95133212672,"data_stored":95133212672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43717,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":798400,"kb_used_data":92902288,"kb_used_omap":110,"kb_used_meta":0,"kb_avail":92900980,"statfs":{"total":95948165120,"available":95130603520,"internally_reserved":1339392,"allocated":95131942912,"data_stored":95131942912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":112892,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]}],"pool_statfs":[]}} 2023-01-25T06:18:16.583 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-01-25T06:18:16.584 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2023-01-25T06:18:16.896 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 21 2023-01-25T06:18:16.896 INFO:teuthology.orchestra.run.smithi088.stdout:fsid 46db3fbd-f892-4dd1-b3a1-5ebdf38661bb 2023-01-25T06:18:16.896 INFO:teuthology.orchestra.run.smithi088.stdout:created 2023-01-25T06:17:56.455100+0000 2023-01-25T06:18:16.897 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2023-01-25T06:18:15.229374+0000 2023-01-25T06:18:16.897 INFO:teuthology.orchestra.run.smithi088.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-01-25T06:18:16.897 INFO:teuthology.orchestra.run.smithi088.stdout:crush_version 5 2023-01-25T06:18:16.897 INFO:teuthology.orchestra.run.smithi088.stdout:full_ratio 0.95 2023-01-25T06:18:16.897 INFO:teuthology.orchestra.run.smithi088.stdout:backfillfull_ratio 0.9 2023-01-25T06:18:16.898 INFO:teuthology.orchestra.run.smithi088.stdout:nearfull_ratio 0.85 2023-01-25T06:18:16.898 INFO:teuthology.orchestra.run.smithi088.stdout:require_min_compat_client luminous 2023-01-25T06:18:16.898 INFO:teuthology.orchestra.run.smithi088.stdout:min_compat_client jewel 2023-01-25T06:18:16.898 INFO:teuthology.orchestra.run.smithi088.stdout:require_osd_release reef 2023-01-25T06:18:16.898 INFO:teuthology.orchestra.run.smithi088.stdout:stretch_mode_enabled false 2023-01-25T06:18:16.899 INFO:teuthology.orchestra.run.smithi088.stdout:pool 1 '.mgr' replicated size 2 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr 2023-01-25T06:18:16.899 INFO:teuthology.orchestra.run.smithi088.stdout:pool 2 'rbd' replicated size 2 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 application rbd 2023-01-25T06:18:16.899 INFO:teuthology.orchestra.run.smithi088.stdout:max_osd 8 2023-01-25T06:18:16.899 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.88:6808/88620,v1:172.21.15.88:6809/88620] [v2:172.21.15.88:6810/88620,v1:172.21.15.88:6811/88620] exists,up 50c76f73-423e-4d2e-81c4-97fa55941951 2023-01-25T06:18:16.899 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 up in weight 1 up_from 13 up_thru 15 down_at 0 last_clean_interval [0,0) [v2:172.21.15.88:6816/88622,v1:172.21.15.88:6817/88622] [v2:172.21.15.88:6818/88622,v1:172.21.15.88:6819/88622] exists,up e5963c22-5fed-4985-b71c-714f9b07878d 2023-01-25T06:18:16.900 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.88:6824/88624,v1:172.21.15.88:6825/88624] [v2:172.21.15.88:6826/88624,v1:172.21.15.88:6827/88624] exists,up f1837a84-aeca-4c85-b79d-acc12a94d495 2023-01-25T06:18:16.900 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.88:6800/88623,v1:172.21.15.88:6801/88623] [v2:172.21.15.88:6802/88623,v1:172.21.15.88:6803/88623] exists,up 6b0008f5-1f8d-44d9-bb08-c04972e98070 2023-01-25T06:18:16.900 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6816/88695,v1:172.21.15.89:6817/88695] [v2:172.21.15.89:6818/88695,v1:172.21.15.89:6819/88695] exists,up b7aaff7f-32a6-44da-851f-ceb299c19b9f 2023-01-25T06:18:16.900 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6800/88693,v1:172.21.15.89:6801/88693] [v2:172.21.15.89:6802/88693,v1:172.21.15.89:6803/88693] exists,up 87dc1a6f-b6fa-4f4d-9084-31a4c1d080c6 2023-01-25T06:18:16.900 INFO:teuthology.orchestra.run.smithi088.stdout:osd.6 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6808/88694,v1:172.21.15.89:6809/88694] [v2:172.21.15.89:6810/88694,v1:172.21.15.89:6811/88694] exists,up be2d1751-e27c-4ec7-b661-9ea9780e8d73 2023-01-25T06:18:16.901 INFO:teuthology.orchestra.run.smithi088.stdout:osd.7 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6823/88714,v1:172.21.15.89:6825/88714] [v2:172.21.15.89:6826/88714,v1:172.21.15.89:6827/88714] exists,up da543c8b-5575-4724-b959-bbdaf8934a17 2023-01-25T06:18:16.909 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.88:6808/88620,v1:172.21.15.88:6809/88620] [v2:172.21.15.88:6810/88620,v1:172.21.15.88:6811/88620] exists,up 50c76f73-423e-4d2e-81c4-97fa55941951', 'osd.1 up in weight 1 up_from 13 up_thru 15 down_at 0 last_clean_interval [0,0) [v2:172.21.15.88:6816/88622,v1:172.21.15.88:6817/88622] [v2:172.21.15.88:6818/88622,v1:172.21.15.88:6819/88622] exists,up e5963c22-5fed-4985-b71c-714f9b07878d', 'osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.88:6824/88624,v1:172.21.15.88:6825/88624] [v2:172.21.15.88:6826/88624,v1:172.21.15.88:6827/88624] exists,up f1837a84-aeca-4c85-b79d-acc12a94d495', 'osd.3 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.88:6800/88623,v1:172.21.15.88:6801/88623] [v2:172.21.15.88:6802/88623,v1:172.21.15.88:6803/88623] exists,up 6b0008f5-1f8d-44d9-bb08-c04972e98070', 'osd.4 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6816/88695,v1:172.21.15.89:6817/88695] [v2:172.21.15.89:6818/88695,v1:172.21.15.89:6819/88695] exists,up b7aaff7f-32a6-44da-851f-ceb299c19b9f', 'osd.5 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6800/88693,v1:172.21.15.89:6801/88693] [v2:172.21.15.89:6802/88693,v1:172.21.15.89:6803/88693] exists,up 87dc1a6f-b6fa-4f4d-9084-31a4c1d080c6', 'osd.6 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6808/88694,v1:172.21.15.89:6809/88694] [v2:172.21.15.89:6810/88694,v1:172.21.15.89:6811/88694] exists,up be2d1751-e27c-4ec7-b661-9ea9780e8d73', 'osd.7 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6823/88714,v1:172.21.15.89:6825/88714] [v2:172.21.15.89:6826/88714,v1:172.21.15.89:6827/88714] exists,up da543c8b-5575-4724-b959-bbdaf8934a17'] 2023-01-25T06:18:16.910 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2023-01-25T06:18:17.030 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-01-25T06:18:17.030 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "mon.a", 2023-01-25T06:18:17.030 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster": "ceph", 2023-01-25T06:18:17.031 INFO:teuthology.orchestra.run.smithi088.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2023-01-25T06:18:17.031 INFO:teuthology.orchestra.run.smithi088.stdout: "admin_socket_mode": "", 2023-01-25T06:18:17.031 INFO:teuthology.orchestra.run.smithi088.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2023-01-25T06:18:17.031 INFO:teuthology.orchestra.run.smithi088.stdout: "auth_client_required": "cephx, none", 2023-01-25T06:18:17.031 INFO:teuthology.orchestra.run.smithi088.stdout: "auth_cluster_required": "cephx", 2023-01-25T06:18:17.032 INFO:teuthology.orchestra.run.smithi088.stdout: "auth_debug": "true", 2023-01-25T06:18:17.032 INFO:teuthology.orchestra.run.smithi088.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2023-01-25T06:18:17.032 INFO:teuthology.orchestra.run.smithi088.stdout: "auth_mon_ticket_ttl": "660.000000", 2023-01-25T06:18:17.032 INFO:teuthology.orchestra.run.smithi088.stdout: "auth_service_required": "cephx", 2023-01-25T06:18:17.032 INFO:teuthology.orchestra.run.smithi088.stdout: "auth_service_ticket_ttl": "240.000000", 2023-01-25T06:18:17.033 INFO:teuthology.orchestra.run.smithi088.stdout: "auth_supported": "cephx", 2023-01-25T06:18:17.033 INFO:teuthology.orchestra.run.smithi088.stdout: "bdev_aio": "true", 2023-01-25T06:18:17.033 INFO:teuthology.orchestra.run.smithi088.stdout: "bdev_aio_max_queue_depth": "1024", 2023-01-25T06:18:17.033 INFO:teuthology.orchestra.run.smithi088.stdout: "bdev_aio_poll_ms": "250", 2023-01-25T06:18:17.033 INFO:teuthology.orchestra.run.smithi088.stdout: "bdev_aio_reap_max": "16", 2023-01-25T06:18:17.033 INFO:teuthology.orchestra.run.smithi088.stdout: "bdev_async_discard": "false", 2023-01-25T06:18:17.034 INFO:teuthology.orchestra.run.smithi088.stdout: "bdev_block_size": "4096", 2023-01-25T06:18:17.034 INFO:teuthology.orchestra.run.smithi088.stdout: "bdev_debug_aio": "false", 2023-01-25T06:18:17.034 INFO:teuthology.orchestra.run.smithi088.stdout: "bdev_debug_aio_log_age": "5.000000", 2023-01-25T06:18:17.034 INFO:teuthology.orchestra.run.smithi088.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2023-01-25T06:18:17.034 INFO:teuthology.orchestra.run.smithi088.stdout: "bdev_debug_inflight_ios": "false", 2023-01-25T06:18:17.035 INFO:teuthology.orchestra.run.smithi088.stdout: "bdev_enable_discard": "false", 2023-01-25T06:18:17.035 INFO:teuthology.orchestra.run.smithi088.stdout: "bdev_flock_retry": "3", 2023-01-25T06:18:17.035 INFO:teuthology.orchestra.run.smithi088.stdout: "bdev_flock_retry_interval": "0.100000", 2023-01-25T06:18:17.035 INFO:teuthology.orchestra.run.smithi088.stdout: "bdev_inject_crash": "0", 2023-01-25T06:18:17.035 INFO:teuthology.orchestra.run.smithi088.stdout: "bdev_inject_crash_flush_delay": "2", 2023-01-25T06:18:17.036 INFO:teuthology.orchestra.run.smithi088.stdout: "bdev_ioring": "false", 2023-01-25T06:18:17.036 INFO:teuthology.orchestra.run.smithi088.stdout: "bdev_ioring_hipri": "false", 2023-01-25T06:18:17.036 INFO:teuthology.orchestra.run.smithi088.stdout: "bdev_ioring_sqthread_poll": "false", 2023-01-25T06:18:17.036 INFO:teuthology.orchestra.run.smithi088.stdout: "bdev_nvme_unbind_from_kernel": "false", 2023-01-25T06:18:17.037 INFO:teuthology.orchestra.run.smithi088.stdout: "bdev_read_buffer_alignment": "4096", 2023-01-25T06:18:17.037 INFO:teuthology.orchestra.run.smithi088.stdout: "bdev_read_preallocated_huge_buffers": "", 2023-01-25T06:18:17.037 INFO:teuthology.orchestra.run.smithi088.stdout: "bdev_type": "", 2023-01-25T06:18:17.037 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_alloc_size": "1048576", 2023-01-25T06:18:17.037 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_allocator": "hybrid", 2023-01-25T06:18:17.038 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_buffered_io": "true", 2023-01-25T06:18:17.038 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_check_for_zeros": "false", 2023-01-25T06:18:17.038 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_check_volume_selector_often": "false", 2023-01-25T06:18:17.038 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_check_volume_selector_on_umount": "false", 2023-01-25T06:18:17.038 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_compact_log_sync": "false", 2023-01-25T06:18:17.039 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2023-01-25T06:18:17.039 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2023-01-25T06:18:17.039 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_log_compact_min_size": "16777216", 2023-01-25T06:18:17.039 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_log_replay_check_allocations": "true", 2023-01-25T06:18:17.039 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_max_log_runway": "4194304", 2023-01-25T06:18:17.039 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_max_prefetch": "1048576", 2023-01-25T06:18:17.040 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_min_flush_size": "524288", 2023-01-25T06:18:17.040 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_min_log_runway": "1048576", 2023-01-25T06:18:17.040 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_replay_recovery": "false", 2023-01-25T06:18:17.040 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_replay_recovery_disable_compact": "false", 2023-01-25T06:18:17.040 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_shared_alloc_size": "65536", 2023-01-25T06:18:17.041 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_sync_write": "false", 2023-01-25T06:18:17.041 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2023-01-25T06:18:17.041 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2023-01-25T06:18:17.041 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2023-01-25T06:18:17.041 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_allocation_from_file": "true", 2023-01-25T06:18:17.042 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_allocator": "hybrid", 2023-01-25T06:18:17.042 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2023-01-25T06:18:17.042 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2023-01-25T06:18:17.042 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2023-01-25T06:18:17.042 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2023-01-25T06:18:17.043 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2023-01-25T06:18:17.043 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_bitmapallocator_span_size": "1024", 2023-01-25T06:18:17.043 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_blobid_prealloc": "10240", 2023-01-25T06:18:17.043 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_block_create": "true", 2023-01-25T06:18:17.043 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_block_db_create": "false", 2023-01-25T06:18:17.044 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_block_db_path": "", 2023-01-25T06:18:17.044 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_block_db_size": "0", 2023-01-25T06:18:17.044 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_block_path": "", 2023-01-25T06:18:17.044 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_block_preallocate_file": "false", 2023-01-25T06:18:17.044 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_block_size": "107374182400", 2023-01-25T06:18:17.045 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_block_wal_create": "false", 2023-01-25T06:18:17.045 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_block_wal_path": "", 2023-01-25T06:18:17.045 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_block_wal_size": "100663296", 2023-01-25T06:18:17.045 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_bluefs": "true", 2023-01-25T06:18:17.045 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2023-01-25T06:18:17.046 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_bluefs_env_mirror": "false", 2023-01-25T06:18:17.046 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_bluefs_max_free": "10737418240", 2023-01-25T06:18:17.046 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2023-01-25T06:18:17.046 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2023-01-25T06:18:17.046 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2023-01-25T06:18:17.046 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2023-01-25T06:18:17.047 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2023-01-25T06:18:17.047 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_autotune": "true", 2023-01-25T06:18:17.047 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_autotune_interval": "5.000000", 2023-01-25T06:18:17.047 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2023-01-25T06:18:17.047 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_kv_ratio": "0.450000", 2023-01-25T06:18:17.048 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_meta_ratio": "0.450000", 2023-01-25T06:18:17.048 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_size": "0", 2023-01-25T06:18:17.048 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_size_hdd": "1073741824", 2023-01-25T06:18:17.048 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_size_ssd": "3221225472", 2023-01-25T06:18:17.048 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_trim_interval": "0.050000", 2023-01-25T06:18:17.049 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2023-01-25T06:18:17.049 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_type": "2q", 2023-01-25T06:18:17.049 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2023-01-25T06:18:17.049 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_clone_cow": "true", 2023-01-25T06:18:17.049 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_compression_algorithm": "snappy", 2023-01-25T06:18:17.049 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_compression_max_blob_size": "0", 2023-01-25T06:18:17.050 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2023-01-25T06:18:17.050 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2023-01-25T06:18:17.050 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_compression_min_blob_size": "0", 2023-01-25T06:18:17.050 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2023-01-25T06:18:17.050 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2023-01-25T06:18:17.051 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_compression_mode": "none", 2023-01-25T06:18:17.051 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_compression_required_ratio": "0.875000", 2023-01-25T06:18:17.051 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_csum_type": "crc32c", 2023-01-25T06:18:17.051 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_debug_enforce_settings": "default", 2023-01-25T06:18:17.051 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_debug_freelist": "false", 2023-01-25T06:18:17.052 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_debug_fsck_abort": "false", 2023-01-25T06:18:17.052 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2023-01-25T06:18:17.052 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_debug_inject_bug21040": "false", 2023-01-25T06:18:17.052 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2023-01-25T06:18:17.052 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_debug_inject_read_err": "false", 2023-01-25T06:18:17.052 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_debug_legacy_omap": "false", 2023-01-25T06:18:17.053 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_debug_no_reuse_blocks": "false", 2023-01-25T06:18:17.053 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_debug_omit_block_device_write": "false", 2023-01-25T06:18:17.053 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_debug_omit_kv_commit": "false", 2023-01-25T06:18:17.053 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2023-01-25T06:18:17.053 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_debug_prefill": "0.000000", 2023-01-25T06:18:17.053 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_debug_prefragment_max": "1048576", 2023-01-25T06:18:17.054 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_debug_random_read_err": "0.000000", 2023-01-25T06:18:17.054 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2023-01-25T06:18:17.054 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_debug_small_allocations": "0", 2023-01-25T06:18:17.054 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2023-01-25T06:18:17.054 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_default_buffered_read": "true", 2023-01-25T06:18:17.054 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_default_buffered_write": "false", 2023-01-25T06:18:17.055 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_deferred_batch_ops": "0", 2023-01-25T06:18:17.055 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2023-01-25T06:18:17.055 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2023-01-25T06:18:17.055 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2023-01-25T06:18:17.055 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_extent_map_shard_max_size": "1200", 2023-01-25T06:18:17.055 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_extent_map_shard_min_size": "150", 2023-01-25T06:18:17.056 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_extent_map_shard_target_size": "500", 2023-01-25T06:18:17.056 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2023-01-25T06:18:17.056 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fail_eio": "false", 2023-01-25T06:18:17.056 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_freelist_blocks_per_key": "128", 2023-01-25T06:18:17.056 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2023-01-25T06:18:17.057 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2023-01-25T06:18:17.057 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2023-01-25T06:18:17.057 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_on_mkfs": "true", 2023-01-25T06:18:17.057 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2023-01-25T06:18:17.057 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_on_mount": "false", 2023-01-25T06:18:17.058 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_on_mount_deep": "false", 2023-01-25T06:18:17.058 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_on_umount": "false", 2023-01-25T06:18:17.058 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_on_umount_deep": "false", 2023-01-25T06:18:17.058 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2023-01-25T06:18:17.058 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_quick_fix_threads": "2", 2023-01-25T06:18:17.058 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2023-01-25T06:18:17.059 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2023-01-25T06:18:17.059 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_gc_enable_blob_threshold": "0", 2023-01-25T06:18:17.059 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_gc_enable_total_threshold": "0", 2023-01-25T06:18:17.059 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2023-01-25T06:18:17.059 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_ignore_data_csum": "false", 2023-01-25T06:18:17.060 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2023-01-25T06:18:17.060 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_kvbackend": "rocksdb", 2023-01-25T06:18:17.060 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_log_collection_list_age": "60.000000", 2023-01-25T06:18:17.060 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2023-01-25T06:18:17.060 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_log_op_age": "5.000000", 2023-01-25T06:18:17.060 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_max_alloc_size": "0", 2023-01-25T06:18:17.061 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_max_blob_size": "0", 2023-01-25T06:18:17.061 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_max_blob_size_hdd": "65536", 2023-01-25T06:18:17.061 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_max_blob_size_ssd": "65536", 2023-01-25T06:18:17.061 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_max_defer_interval": "3.000000", 2023-01-25T06:18:17.061 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_max_deferred_txc": "32", 2023-01-25T06:18:17.061 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_min_alloc_size": "0", 2023-01-25T06:18:17.062 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_min_alloc_size_hdd": "4096", 2023-01-25T06:18:17.062 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_min_alloc_size_ssd": "4096", 2023-01-25T06:18:17.062 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_nid_prealloc": "1024", 2023-01-25T06:18:17.062 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_prefer_deferred_size": "0", 2023-01-25T06:18:17.062 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2023-01-25T06:18:17.062 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2023-01-25T06:18:17.063 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_qfsck_on_mount": "true", 2023-01-25T06:18:17.063 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_retry_disk_reads": "3", 2023-01-25T06:18:17.063 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_rocksdb_cf": "true", 2023-01-25T06:18:17.063 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L P", 2023-01-25T06:18:17.063 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_rocksdb_options": "compression=kNoCompression,max_write_buffer_number=128,min_write_buffer_number_to_merge=16,compaction_style=kCompactionStyleLevel,write_buffer_size=8388608,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0,ttl=21600", 2023-01-25T06:18:17.063 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_rocksdb_options_annex": "", 2023-01-25T06:18:17.064 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_spdk_coremask": "0x1", 2023-01-25T06:18:17.064 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_spdk_io_sleep": "5", 2023-01-25T06:18:17.064 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_spdk_max_io_completion": "0", 2023-01-25T06:18:17.064 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_spdk_mem": "512", 2023-01-25T06:18:17.064 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_sync_submit_transaction": "false", 2023-01-25T06:18:17.065 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_throttle_bytes": "67108864", 2023-01-25T06:18:17.065 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_throttle_cost_per_io": "0", 2023-01-25T06:18:17.065 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2023-01-25T06:18:17.065 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2023-01-25T06:18:17.065 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2023-01-25T06:18:17.065 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_throttle_trace_rate": "0.000000", 2023-01-25T06:18:17.066 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_tracing": "false", 2023-01-25T06:18:17.066 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2023-01-25T06:18:17.066 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2023-01-25T06:18:17.066 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_volume_selection_reserved": "0", 2023-01-25T06:18:17.066 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2023-01-25T06:18:17.066 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2023-01-25T06:18:17.067 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_warn_on_legacy_statfs": "true", 2023-01-25T06:18:17.067 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2023-01-25T06:18:17.067 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2023-01-25T06:18:17.067 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2023-01-25T06:18:17.067 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_zero_block_detection": "false", 2023-01-25T06:18:17.068 INFO:teuthology.orchestra.run.smithi088.stdout: "cephadm_path": "/usr/sbin/cephadm", 2023-01-25T06:18:17.068 INFO:teuthology.orchestra.run.smithi088.stdout: "cephfs_mirror_action_update_interval": "2", 2023-01-25T06:18:17.068 INFO:teuthology.orchestra.run.smithi088.stdout: "cephfs_mirror_directory_scan_interval": "10", 2023-01-25T06:18:17.068 INFO:teuthology.orchestra.run.smithi088.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2023-01-25T06:18:17.068 INFO:teuthology.orchestra.run.smithi088.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2023-01-25T06:18:17.069 INFO:teuthology.orchestra.run.smithi088.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2023-01-25T06:18:17.069 INFO:teuthology.orchestra.run.smithi088.stdout: "cephfs_mirror_mount_timeout": "10", 2023-01-25T06:18:17.069 INFO:teuthology.orchestra.run.smithi088.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2023-01-25T06:18:17.069 INFO:teuthology.orchestra.run.smithi088.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2023-01-25T06:18:17.069 INFO:teuthology.orchestra.run.smithi088.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2023-01-25T06:18:17.069 INFO:teuthology.orchestra.run.smithi088.stdout: "cephsqlite_blocklist_dead_locker": "true", 2023-01-25T06:18:17.070 INFO:teuthology.orchestra.run.smithi088.stdout: "cephsqlite_lock_renewal_interval": "2000", 2023-01-25T06:18:17.070 INFO:teuthology.orchestra.run.smithi088.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2023-01-25T06:18:17.070 INFO:teuthology.orchestra.run.smithi088.stdout: "cephx_cluster_require_signatures": "false", 2023-01-25T06:18:17.070 INFO:teuthology.orchestra.run.smithi088.stdout: "cephx_cluster_require_version": "2", 2023-01-25T06:18:17.070 INFO:teuthology.orchestra.run.smithi088.stdout: "cephx_require_signatures": "false", 2023-01-25T06:18:17.070 INFO:teuthology.orchestra.run.smithi088.stdout: "cephx_require_version": "2", 2023-01-25T06:18:17.071 INFO:teuthology.orchestra.run.smithi088.stdout: "cephx_service_require_signatures": "false", 2023-01-25T06:18:17.071 INFO:teuthology.orchestra.run.smithi088.stdout: "cephx_service_require_version": "2", 2023-01-25T06:18:17.071 INFO:teuthology.orchestra.run.smithi088.stdout: "cephx_sign_messages": "true", 2023-01-25T06:18:17.071 INFO:teuthology.orchestra.run.smithi088.stdout: "chdir": "", 2023-01-25T06:18:17.071 INFO:teuthology.orchestra.run.smithi088.stdout: "client_acl_type": "", 2023-01-25T06:18:17.071 INFO:teuthology.orchestra.run.smithi088.stdout: "client_asio_thread_count": "2", 2023-01-25T06:18:17.072 INFO:teuthology.orchestra.run.smithi088.stdout: "client_cache_mid": "0.750000", 2023-01-25T06:18:17.072 INFO:teuthology.orchestra.run.smithi088.stdout: "client_cache_size": "16384", 2023-01-25T06:18:17.072 INFO:teuthology.orchestra.run.smithi088.stdout: "client_caps_release_delay": "5", 2023-01-25T06:18:17.072 INFO:teuthology.orchestra.run.smithi088.stdout: "client_check_pool_perm": "true", 2023-01-25T06:18:17.072 INFO:teuthology.orchestra.run.smithi088.stdout: "client_collect_and_send_global_metrics": "false", 2023-01-25T06:18:17.073 INFO:teuthology.orchestra.run.smithi088.stdout: "client_debug_force_sync_read": "false", 2023-01-25T06:18:17.073 INFO:teuthology.orchestra.run.smithi088.stdout: "client_debug_getattr_caps": "false", 2023-01-25T06:18:17.073 INFO:teuthology.orchestra.run.smithi088.stdout: "client_debug_inject_tick_delay": "0", 2023-01-25T06:18:17.073 INFO:teuthology.orchestra.run.smithi088.stdout: "client_die_on_failed_dentry_invalidate": "true", 2023-01-25T06:18:17.073 INFO:teuthology.orchestra.run.smithi088.stdout: "client_die_on_failed_remount": "false", 2023-01-25T06:18:17.073 INFO:teuthology.orchestra.run.smithi088.stdout: "client_dirsize_rbytes": "true", 2023-01-25T06:18:17.074 INFO:teuthology.orchestra.run.smithi088.stdout: "client_force_lazyio": "false", 2023-01-25T06:18:17.074 INFO:teuthology.orchestra.run.smithi088.stdout: "client_fs": "", 2023-01-25T06:18:17.074 INFO:teuthology.orchestra.run.smithi088.stdout: "client_inject_fixed_oldest_tid": "false", 2023-01-25T06:18:17.074 INFO:teuthology.orchestra.run.smithi088.stdout: "client_inject_release_failure": "false", 2023-01-25T06:18:17.074 INFO:teuthology.orchestra.run.smithi088.stdout: "client_max_inline_size": "4096", 2023-01-25T06:18:17.074 INFO:teuthology.orchestra.run.smithi088.stdout: "client_mds_namespace": "", 2023-01-25T06:18:17.075 INFO:teuthology.orchestra.run.smithi088.stdout: "client_metadata": "", 2023-01-25T06:18:17.075 INFO:teuthology.orchestra.run.smithi088.stdout: "client_mount_gid": "-1", 2023-01-25T06:18:17.075 INFO:teuthology.orchestra.run.smithi088.stdout: "client_mount_timeout": "300", 2023-01-25T06:18:17.075 INFO:teuthology.orchestra.run.smithi088.stdout: "client_mount_uid": "-1", 2023-01-25T06:18:17.075 INFO:teuthology.orchestra.run.smithi088.stdout: "client_mountpoint": "/", 2023-01-25T06:18:17.075 INFO:teuthology.orchestra.run.smithi088.stdout: "client_notify_timeout": "10", 2023-01-25T06:18:17.076 INFO:teuthology.orchestra.run.smithi088.stdout: "client_oc": "true", 2023-01-25T06:18:17.076 INFO:teuthology.orchestra.run.smithi088.stdout: "client_oc_max_dirty": "104857600", 2023-01-25T06:18:17.076 INFO:teuthology.orchestra.run.smithi088.stdout: "client_oc_max_dirty_age": "5.000000", 2023-01-25T06:18:17.076 INFO:teuthology.orchestra.run.smithi088.stdout: "client_oc_max_objects": "1000", 2023-01-25T06:18:17.077 INFO:teuthology.orchestra.run.smithi088.stdout: "client_oc_size": "209715200", 2023-01-25T06:18:17.077 INFO:teuthology.orchestra.run.smithi088.stdout: "client_oc_target_dirty": "8388608", 2023-01-25T06:18:17.077 INFO:teuthology.orchestra.run.smithi088.stdout: "client_permissions": "true", 2023-01-25T06:18:17.077 INFO:teuthology.orchestra.run.smithi088.stdout: "client_quota": "true", 2023-01-25T06:18:17.077 INFO:teuthology.orchestra.run.smithi088.stdout: "client_quota_df": "true", 2023-01-25T06:18:17.077 INFO:teuthology.orchestra.run.smithi088.stdout: "client_readahead_max_bytes": "0", 2023-01-25T06:18:17.078 INFO:teuthology.orchestra.run.smithi088.stdout: "client_readahead_max_periods": "4", 2023-01-25T06:18:17.078 INFO:teuthology.orchestra.run.smithi088.stdout: "client_readahead_min": "131072", 2023-01-25T06:18:17.078 INFO:teuthology.orchestra.run.smithi088.stdout: "client_reconnect_stale": "false", 2023-01-25T06:18:17.078 INFO:teuthology.orchestra.run.smithi088.stdout: "client_shutdown_timeout": "30", 2023-01-25T06:18:17.078 INFO:teuthology.orchestra.run.smithi088.stdout: "client_snapdir": ".snap", 2023-01-25T06:18:17.078 INFO:teuthology.orchestra.run.smithi088.stdout: "client_tick_interval": "1", 2023-01-25T06:18:17.079 INFO:teuthology.orchestra.run.smithi088.stdout: "client_trace": "", 2023-01-25T06:18:17.079 INFO:teuthology.orchestra.run.smithi088.stdout: "client_try_dentry_invalidate": "false", 2023-01-25T06:18:17.079 INFO:teuthology.orchestra.run.smithi088.stdout: "client_use_faked_inos": "false", 2023-01-25T06:18:17.079 INFO:teuthology.orchestra.run.smithi088.stdout: "client_use_random_mds": "false", 2023-01-25T06:18:17.079 INFO:teuthology.orchestra.run.smithi088.stdout: "clog_to_graylog": "false", 2023-01-25T06:18:17.079 INFO:teuthology.orchestra.run.smithi088.stdout: "clog_to_graylog_host": "127.0.0.1", 2023-01-25T06:18:17.080 INFO:teuthology.orchestra.run.smithi088.stdout: "clog_to_graylog_port": "12201", 2023-01-25T06:18:17.080 INFO:teuthology.orchestra.run.smithi088.stdout: "clog_to_monitors": "default=true", 2023-01-25T06:18:17.080 INFO:teuthology.orchestra.run.smithi088.stdout: "clog_to_syslog": "false", 2023-01-25T06:18:17.080 INFO:teuthology.orchestra.run.smithi088.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2023-01-25T06:18:17.080 INFO:teuthology.orchestra.run.smithi088.stdout: "clog_to_syslog_level": "info", 2023-01-25T06:18:17.081 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_addr": "-", 2023-01-25T06:18:17.081 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_network": "", 2023-01-25T06:18:17.081 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_network_interface": "", 2023-01-25T06:18:17.081 INFO:teuthology.orchestra.run.smithi088.stdout: "compressor_zlib_isal": "false", 2023-01-25T06:18:17.081 INFO:teuthology.orchestra.run.smithi088.stdout: "compressor_zlib_level": "5", 2023-01-25T06:18:17.081 INFO:teuthology.orchestra.run.smithi088.stdout: "compressor_zlib_winsize": "-15", 2023-01-25T06:18:17.082 INFO:teuthology.orchestra.run.smithi088.stdout: "compressor_zstd_level": "1", 2023-01-25T06:18:17.082 INFO:teuthology.orchestra.run.smithi088.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2023-01-25T06:18:17.082 INFO:teuthology.orchestra.run.smithi088.stdout: "crash_dir": "/var/lib/ceph/crash", 2023-01-25T06:18:17.082 INFO:teuthology.orchestra.run.smithi088.stdout: "crimson_alien_op_num_threads": "6", 2023-01-25T06:18:17.082 INFO:teuthology.orchestra.run.smithi088.stdout: "crimson_alien_thread_cpu_cores": "", 2023-01-25T06:18:17.082 INFO:teuthology.orchestra.run.smithi088.stdout: "crimson_osd_obc_lru_size": "10", 2023-01-25T06:18:17.083 INFO:teuthology.orchestra.run.smithi088.stdout: "crimson_osd_scheduler_concurrency": "0", 2023-01-25T06:18:17.083 INFO:teuthology.orchestra.run.smithi088.stdout: "crimson_seastar_smp": "1", 2023-01-25T06:18:17.083 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "", 2023-01-25T06:18:17.083 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location_hook": "", 2023-01-25T06:18:17.083 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location_hook_timeout": "10", 2023-01-25T06:18:17.084 INFO:teuthology.orchestra.run.smithi088.stdout: "daemonize": "false", 2023-01-25T06:18:17.084 INFO:teuthology.orchestra.run.smithi088.stdout: "daos_pool": "tank", 2023-01-25T06:18:17.084 INFO:teuthology.orchestra.run.smithi088.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2023-01-25T06:18:17.084 INFO:teuthology.orchestra.run.smithi088.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2023-01-25T06:18:17.084 INFO:teuthology.orchestra.run.smithi088.stdout: "dbstore_db_name_prefix": "dbstore", 2023-01-25T06:18:17.085 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_alienstore": "0/5", 2023-01-25T06:18:17.085 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_allow_any_pool_priority": "false", 2023-01-25T06:18:17.085 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_asok": "1/5", 2023-01-25T06:18:17.085 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_asok_assert_abort": "false", 2023-01-25T06:18:17.085 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_asserts_on_shutdown": "true", 2023-01-25T06:18:17.085 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_auth": "20/20", 2023-01-25T06:18:17.086 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_bdev": "1/3", 2023-01-25T06:18:17.086 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_bluefs": "1/5", 2023-01-25T06:18:17.086 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_bluestore": "1/5", 2023-01-25T06:18:17.086 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_buffer": "0/1", 2023-01-25T06:18:17.086 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_ceph_exporter": "1/5", 2023-01-25T06:18:17.086 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_cephfs_mirror": "0/5", 2023-01-25T06:18:17.087 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_cephsqlite": "0/5", 2023-01-25T06:18:17.087 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_client": "0/5", 2023-01-25T06:18:17.087 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_compressor": "1/5", 2023-01-25T06:18:17.087 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_context": "0/1", 2023-01-25T06:18:17.087 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_crush": "1/1", 2023-01-25T06:18:17.087 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_crypto": "1/5", 2023-01-25T06:18:17.088 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_cyanstore": "0/5", 2023-01-25T06:18:17.088 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_deliberately_leak_memory": "false", 2023-01-25T06:18:17.088 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_disable_randomized_ping": "false", 2023-01-25T06:18:17.088 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_dpdk": "1/5", 2023-01-25T06:18:17.088 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_eventtrace": "1/5", 2023-01-25T06:18:17.088 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_filer": "0/1", 2023-01-25T06:18:17.089 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_filestore": "1/3", 2023-01-25T06:18:17.089 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_finisher": "1/1", 2023-01-25T06:18:17.089 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_fuse": "1/5", 2023-01-25T06:18:17.089 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_heartbeat_testing_span": "0", 2023-01-25T06:18:17.089 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_heartbeatmap": "1/5", 2023-01-25T06:18:17.089 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_immutable_obj_cache": "0/5", 2023-01-25T06:18:17.090 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_javaclient": "1/5", 2023-01-25T06:18:17.090 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_journal": "1/3", 2023-01-25T06:18:17.090 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_journaler": "0/5", 2023-01-25T06:18:17.090 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_kstore": "1/5", 2023-01-25T06:18:17.090 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_leveldb": "4/5", 2023-01-25T06:18:17.090 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_lockdep": "0/1", 2023-01-25T06:18:17.091 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_mclock": "1/5", 2023-01-25T06:18:17.091 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_mds": "1/5", 2023-01-25T06:18:17.091 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_mds_balancer": "1/5", 2023-01-25T06:18:17.091 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_mds_locker": "1/5", 2023-01-25T06:18:17.091 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_mds_log": "1/5", 2023-01-25T06:18:17.091 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_mds_log_expire": "1/5", 2023-01-25T06:18:17.092 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_mds_migrator": "1/5", 2023-01-25T06:18:17.092 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_memstore": "1/5", 2023-01-25T06:18:17.092 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_mgr": "2/5", 2023-01-25T06:18:17.092 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_mgrc": "1/5", 2023-01-25T06:18:17.092 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_mon": "20/20", 2023-01-25T06:18:17.093 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_monc": "0/10", 2023-01-25T06:18:17.093 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_ms": "1/1", 2023-01-25T06:18:17.093 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_none": "0/5", 2023-01-25T06:18:17.093 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_objclass": "0/5", 2023-01-25T06:18:17.093 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_objectcacher": "0/5", 2023-01-25T06:18:17.094 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_objecter": "0/1", 2023-01-25T06:18:17.094 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_optracker": "0/5", 2023-01-25T06:18:17.094 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_osd": "1/5", 2023-01-25T06:18:17.094 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_paxos": "20/20", 2023-01-25T06:18:17.094 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_perfcounter": "1/5", 2023-01-25T06:18:17.094 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_prioritycache": "1/5", 2023-01-25T06:18:17.095 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_rados": "0/5", 2023-01-25T06:18:17.095 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_rbd": "0/5", 2023-01-25T06:18:17.095 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_rbd_mirror": "0/5", 2023-01-25T06:18:17.095 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_rbd_pwl": "0/5", 2023-01-25T06:18:17.095 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_rbd_replay": "0/5", 2023-01-25T06:18:17.095 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_refs": "0/0", 2023-01-25T06:18:17.096 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_reserver": "1/1", 2023-01-25T06:18:17.096 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_rgw": "1/5", 2023-01-25T06:18:17.096 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_rgw_access": "1/5", 2023-01-25T06:18:17.096 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_rgw_datacache": "1/5", 2023-01-25T06:18:17.096 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_rgw_dbstore": "1/5", 2023-01-25T06:18:17.096 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_rgw_flight": "1/5", 2023-01-25T06:18:17.097 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_rgw_sync": "1/5", 2023-01-25T06:18:17.097 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_rocksdb": "4/5", 2023-01-25T06:18:17.097 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_seastore": "0/5", 2023-01-25T06:18:17.097 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_seastore_backref": "0/5", 2023-01-25T06:18:17.097 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_seastore_cache": "0/5", 2023-01-25T06:18:17.097 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_seastore_cleaner": "0/5", 2023-01-25T06:18:17.098 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_seastore_device": "0/5", 2023-01-25T06:18:17.098 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_seastore_epm": "0/5", 2023-01-25T06:18:17.098 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_seastore_fixedkv_tree": "0/5", 2023-01-25T06:18:17.098 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_seastore_journal": "0/5", 2023-01-25T06:18:17.098 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_seastore_lba": "0/5", 2023-01-25T06:18:17.098 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_seastore_odata": "0/5", 2023-01-25T06:18:17.099 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_seastore_omap": "0/5", 2023-01-25T06:18:17.099 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_seastore_onode": "0/5", 2023-01-25T06:18:17.099 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_seastore_t": "0/5", 2023-01-25T06:18:17.099 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_seastore_tm": "0/5", 2023-01-25T06:18:17.099 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_striper": "0/1", 2023-01-25T06:18:17.099 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_test": "0/5", 2023-01-25T06:18:17.100 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_throttle": "1/1", 2023-01-25T06:18:17.100 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_timer": "0/1", 2023-01-25T06:18:17.100 INFO:teuthology.orchestra.run.smithi088.stdout: "debug_tp": "0/5", 2023-01-25T06:18:17.100 INFO:teuthology.orchestra.run.smithi088.stdout: "device_failure_prediction_mode": "none", 2023-01-25T06:18:17.100 INFO:teuthology.orchestra.run.smithi088.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2023-01-25T06:18:17.101 INFO:teuthology.orchestra.run.smithi088.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2023-01-25T06:18:17.101 INFO:teuthology.orchestra.run.smithi088.stdout: "err_to_graylog": "false", 2023-01-25T06:18:17.101 INFO:teuthology.orchestra.run.smithi088.stdout: "err_to_journald": "false", 2023-01-25T06:18:17.101 INFO:teuthology.orchestra.run.smithi088.stdout: "err_to_stderr": "true", 2023-01-25T06:18:17.101 INFO:teuthology.orchestra.run.smithi088.stdout: "err_to_syslog": "false", 2023-01-25T06:18:17.101 INFO:teuthology.orchestra.run.smithi088.stdout: "event_tracing": "false", 2023-01-25T06:18:17.102 INFO:teuthology.orchestra.run.smithi088.stdout: "exporter_addr": "0.0.0.0", 2023-01-25T06:18:17.102 INFO:teuthology.orchestra.run.smithi088.stdout: "exporter_http_port": "9926", 2023-01-25T06:18:17.102 INFO:teuthology.orchestra.run.smithi088.stdout: "exporter_prio_limit": "5", 2023-01-25T06:18:17.102 INFO:teuthology.orchestra.run.smithi088.stdout: "exporter_sock_dir": "/var/run/ceph/", 2023-01-25T06:18:17.102 INFO:teuthology.orchestra.run.smithi088.stdout: "exporter_sort_metrics": "true", 2023-01-25T06:18:17.102 INFO:teuthology.orchestra.run.smithi088.stdout: "exporter_stats_period": "5", 2023-01-25T06:18:17.103 INFO:teuthology.orchestra.run.smithi088.stdout: "fake_statfs_for_testing": "0", 2023-01-25T06:18:17.103 INFO:teuthology.orchestra.run.smithi088.stdout: "fatal_signal_handlers": "true", 2023-01-25T06:18:17.103 INFO:teuthology.orchestra.run.smithi088.stdout: "filer_max_purge_ops": "10", 2023-01-25T06:18:17.103 INFO:teuthology.orchestra.run.smithi088.stdout: "filer_max_truncate_ops": "128", 2023-01-25T06:18:17.103 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_apply_finisher_threads": "1", 2023-01-25T06:18:17.103 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_blackhole": "false", 2023-01-25T06:18:17.104 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_btrfs_clone_range": "true", 2023-01-25T06:18:17.104 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_btrfs_snap": "true", 2023-01-25T06:18:17.104 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_caller_concurrency": "10", 2023-01-25T06:18:17.104 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_collect_device_partition_information": "true", 2023-01-25T06:18:17.104 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_commit_timeout": "600.000000", 2023-01-25T06:18:17.105 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_debug_inject_read_err": "false", 2023-01-25T06:18:17.105 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_debug_omap_check": "false", 2023-01-25T06:18:17.105 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_debug_random_read_err": "0.000000", 2023-01-25T06:18:17.105 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_debug_verify_split": "false", 2023-01-25T06:18:17.105 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_dump_file": "", 2023-01-25T06:18:17.106 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2023-01-25T06:18:17.106 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_expected_throughput_ops": "200.000000", 2023-01-25T06:18:17.106 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_fadvise": "true", 2023-01-25T06:18:17.106 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_fail_eio": "true", 2023-01-25T06:18:17.106 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_fd_cache_shards": "16", 2023-01-25T06:18:17.106 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_fd_cache_size": "128", 2023-01-25T06:18:17.107 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_fiemap": "false", 2023-01-25T06:18:17.107 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_fiemap_threshold": "4096", 2023-01-25T06:18:17.107 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_fsync_flushes_journal_data": "false", 2023-01-25T06:18:17.107 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_index_retry_probability": "0.000000", 2023-01-25T06:18:17.107 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_inject_stall": "0", 2023-01-25T06:18:17.107 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_journal_parallel": "false", 2023-01-25T06:18:17.108 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_journal_trailing": "false", 2023-01-25T06:18:17.108 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_journal_writeahead": "false", 2023-01-25T06:18:17.108 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_kill_at": "0", 2023-01-25T06:18:17.108 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_max_alloc_hint_size": "1048576", 2023-01-25T06:18:17.108 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_max_inline_xattr_size": "0", 2023-01-25T06:18:17.108 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2023-01-25T06:18:17.109 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_max_inline_xattr_size_other": "512", 2023-01-25T06:18:17.109 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2023-01-25T06:18:17.109 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_max_inline_xattrs": "0", 2023-01-25T06:18:17.109 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2023-01-25T06:18:17.109 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_max_inline_xattrs_other": "2", 2023-01-25T06:18:17.109 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_max_inline_xattrs_xfs": "10", 2023-01-25T06:18:17.110 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_max_sync_interval": "5.000000", 2023-01-25T06:18:17.110 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_max_xattr_value_size": "0", 2023-01-25T06:18:17.110 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2023-01-25T06:18:17.110 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_max_xattr_value_size_other": "1024", 2023-01-25T06:18:17.110 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2023-01-25T06:18:17.110 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_merge_threshold": "-10", 2023-01-25T06:18:17.111 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_min_sync_interval": "0.010000", 2023-01-25T06:18:17.111 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_odsync_write": "false", 2023-01-25T06:18:17.111 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_omap_backend": "rocksdb", 2023-01-25T06:18:17.111 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_omap_backend_path": "", 2023-01-25T06:18:17.111 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_omap_header_cache_size": "1024", 2023-01-25T06:18:17.111 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_ondisk_finisher_threads": "1", 2023-01-25T06:18:17.112 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_op_thread_suicide_timeout": "180", 2023-01-25T06:18:17.112 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_op_thread_timeout": "60", 2023-01-25T06:18:17.112 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_op_threads": "2", 2023-01-25T06:18:17.112 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_punch_hole": "false", 2023-01-25T06:18:17.112 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2023-01-25T06:18:17.112 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2023-01-25T06:18:17.113 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2023-01-25T06:18:17.113 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_queue_high_threshhold": "0.900000", 2023-01-25T06:18:17.113 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_queue_low_threshhold": "0.300000", 2023-01-25T06:18:17.113 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_queue_max_bytes": "104857600", 2023-01-25T06:18:17.113 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2023-01-25T06:18:17.113 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2023-01-25T06:18:17.114 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2023-01-25T06:18:17.114 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_queue_max_ops": "50", 2023-01-25T06:18:17.114 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2023-01-25T06:18:17.114 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_seek_data_hole": "false", 2023-01-25T06:18:17.114 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_sloppy_crc": "false", 2023-01-25T06:18:17.114 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_sloppy_crc_block_size": "65536", 2023-01-25T06:18:17.115 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_splice": "false", 2023-01-25T06:18:17.115 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_split_multiple": "2", 2023-01-25T06:18:17.115 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_split_rand_factor": "20", 2023-01-25T06:18:17.115 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_update_to": "1000", 2023-01-25T06:18:17.115 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2023-01-25T06:18:17.115 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2023-01-25T06:18:17.116 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2023-01-25T06:18:17.116 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2023-01-25T06:18:17.116 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2023-01-25T06:18:17.116 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2023-01-25T06:18:17.116 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_wbthrottle_enable": "true", 2023-01-25T06:18:17.116 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2023-01-25T06:18:17.117 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2023-01-25T06:18:17.117 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2023-01-25T06:18:17.117 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2023-01-25T06:18:17.117 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2023-01-25T06:18:17.117 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2023-01-25T06:18:17.117 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_xfs_extsize": "false", 2023-01-25T06:18:17.118 INFO:teuthology.orchestra.run.smithi088.stdout: "filestore_zfs_snap": "false", 2023-01-25T06:18:17.118 INFO:teuthology.orchestra.run.smithi088.stdout: "fio_dir": "/tmp/fio", 2023-01-25T06:18:17.118 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "46db3fbd-f892-4dd1-b3a1-5ebdf38661bb", 2023-01-25T06:18:17.118 INFO:teuthology.orchestra.run.smithi088.stdout: "fuse_allow_other": "true", 2023-01-25T06:18:17.118 INFO:teuthology.orchestra.run.smithi088.stdout: "fuse_atomic_o_trunc": "true", 2023-01-25T06:18:17.119 INFO:teuthology.orchestra.run.smithi088.stdout: "fuse_big_writes": "true", 2023-01-25T06:18:17.119 INFO:teuthology.orchestra.run.smithi088.stdout: "fuse_debug": "false", 2023-01-25T06:18:17.119 INFO:teuthology.orchestra.run.smithi088.stdout: "fuse_default_permissions": "false", 2023-01-25T06:18:17.119 INFO:teuthology.orchestra.run.smithi088.stdout: "fuse_disable_pagecache": "false", 2023-01-25T06:18:17.119 INFO:teuthology.orchestra.run.smithi088.stdout: "fuse_max_write": "0", 2023-01-25T06:18:17.120 INFO:teuthology.orchestra.run.smithi088.stdout: "fuse_multithreaded": "true", 2023-01-25T06:18:17.120 INFO:teuthology.orchestra.run.smithi088.stdout: "fuse_require_active_mds": "true", 2023-01-25T06:18:17.120 INFO:teuthology.orchestra.run.smithi088.stdout: "fuse_set_user_groups": "true", 2023-01-25T06:18:17.120 INFO:teuthology.orchestra.run.smithi088.stdout: "fuse_splice_move": "true", 2023-01-25T06:18:17.120 INFO:teuthology.orchestra.run.smithi088.stdout: "fuse_splice_read": "true", 2023-01-25T06:18:17.120 INFO:teuthology.orchestra.run.smithi088.stdout: "fuse_splice_write": "true", 2023-01-25T06:18:17.121 INFO:teuthology.orchestra.run.smithi088.stdout: "fuse_syncfs_on_mksnap": "true", 2023-01-25T06:18:17.121 INFO:teuthology.orchestra.run.smithi088.stdout: "fuse_use_invalidate_cb": "true", 2023-01-25T06:18:17.121 INFO:teuthology.orchestra.run.smithi088.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2023-01-25T06:18:17.121 INFO:teuthology.orchestra.run.smithi088.stdout: "gss_target_name": "ceph", 2023-01-25T06:18:17.121 INFO:teuthology.orchestra.run.smithi088.stdout: "heartbeat_file": "", 2023-01-25T06:18:17.122 INFO:teuthology.orchestra.run.smithi088.stdout: "heartbeat_inject_failure": "0", 2023-01-25T06:18:17.122 INFO:teuthology.orchestra.run.smithi088.stdout: "heartbeat_interval": "5", 2023-01-25T06:18:17.122 INFO:teuthology.orchestra.run.smithi088.stdout: "host": "smithi088", 2023-01-25T06:18:17.122 INFO:teuthology.orchestra.run.smithi088.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2023-01-25T06:18:17.122 INFO:teuthology.orchestra.run.smithi088.stdout: "immutable_object_cache_max_inflight_ops": "128", 2023-01-25T06:18:17.123 INFO:teuthology.orchestra.run.smithi088.stdout: "immutable_object_cache_max_size": "1073741824", 2023-01-25T06:18:17.123 INFO:teuthology.orchestra.run.smithi088.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2023-01-25T06:18:17.123 INFO:teuthology.orchestra.run.smithi088.stdout: "immutable_object_cache_qos_bps_burst": "0", 2023-01-25T06:18:17.123 INFO:teuthology.orchestra.run.smithi088.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2023-01-25T06:18:17.123 INFO:teuthology.orchestra.run.smithi088.stdout: "immutable_object_cache_qos_bps_limit": "0", 2023-01-25T06:18:17.123 INFO:teuthology.orchestra.run.smithi088.stdout: "immutable_object_cache_qos_iops_burst": "0", 2023-01-25T06:18:17.124 INFO:teuthology.orchestra.run.smithi088.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2023-01-25T06:18:17.124 INFO:teuthology.orchestra.run.smithi088.stdout: "immutable_object_cache_qos_iops_limit": "0", 2023-01-25T06:18:17.124 INFO:teuthology.orchestra.run.smithi088.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2023-01-25T06:18:17.124 INFO:teuthology.orchestra.run.smithi088.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2023-01-25T06:18:17.124 INFO:teuthology.orchestra.run.smithi088.stdout: "immutable_object_cache_watermark": "0.900000", 2023-01-25T06:18:17.124 INFO:teuthology.orchestra.run.smithi088.stdout: "inject_early_sigterm": "false", 2023-01-25T06:18:17.125 INFO:teuthology.orchestra.run.smithi088.stdout: "jaeger_tracing_enable": "false", 2023-01-25T06:18:17.125 INFO:teuthology.orchestra.run.smithi088.stdout: "journal_aio": "true", 2023-01-25T06:18:17.125 INFO:teuthology.orchestra.run.smithi088.stdout: "journal_align_min_size": "65536", 2023-01-25T06:18:17.125 INFO:teuthology.orchestra.run.smithi088.stdout: "journal_block_align": "true", 2023-01-25T06:18:17.125 INFO:teuthology.orchestra.run.smithi088.stdout: "journal_block_size": "4096", 2023-01-25T06:18:17.125 INFO:teuthology.orchestra.run.smithi088.stdout: "journal_dio": "true", 2023-01-25T06:18:17.126 INFO:teuthology.orchestra.run.smithi088.stdout: "journal_discard": "false", 2023-01-25T06:18:17.126 INFO:teuthology.orchestra.run.smithi088.stdout: "journal_force_aio": "false", 2023-01-25T06:18:17.126 INFO:teuthology.orchestra.run.smithi088.stdout: "journal_ignore_corruption": "false", 2023-01-25T06:18:17.126 INFO:teuthology.orchestra.run.smithi088.stdout: "journal_max_write_bytes": "10485760", 2023-01-25T06:18:17.126 INFO:teuthology.orchestra.run.smithi088.stdout: "journal_max_write_entries": "100", 2023-01-25T06:18:17.126 INFO:teuthology.orchestra.run.smithi088.stdout: "journal_replay_from": "0", 2023-01-25T06:18:17.127 INFO:teuthology.orchestra.run.smithi088.stdout: "journal_throttle_high_multiple": "0.000000", 2023-01-25T06:18:17.127 INFO:teuthology.orchestra.run.smithi088.stdout: "journal_throttle_high_threshhold": "0.900000", 2023-01-25T06:18:17.127 INFO:teuthology.orchestra.run.smithi088.stdout: "journal_throttle_low_threshhold": "0.600000", 2023-01-25T06:18:17.127 INFO:teuthology.orchestra.run.smithi088.stdout: "journal_throttle_max_multiple": "0.000000", 2023-01-25T06:18:17.127 INFO:teuthology.orchestra.run.smithi088.stdout: "journal_write_header_frequency": "0", 2023-01-25T06:18:17.127 INFO:teuthology.orchestra.run.smithi088.stdout: "journal_zero_on_create": "false", 2023-01-25T06:18:17.128 INFO:teuthology.orchestra.run.smithi088.stdout: "journaler_prefetch_periods": "10", 2023-01-25T06:18:17.128 INFO:teuthology.orchestra.run.smithi088.stdout: "journaler_prezero_periods": "5", 2023-01-25T06:18:17.128 INFO:teuthology.orchestra.run.smithi088.stdout: "journaler_write_head_interval": "15", 2023-01-25T06:18:17.128 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "", 2023-01-25T06:18:17.128 INFO:teuthology.orchestra.run.smithi088.stdout: "keyfile": "", 2023-01-25T06:18:17.129 INFO:teuthology.orchestra.run.smithi088.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2023-01-25T06:18:17.129 INFO:teuthology.orchestra.run.smithi088.stdout: "kstore_backend": "rocksdb", 2023-01-25T06:18:17.129 INFO:teuthology.orchestra.run.smithi088.stdout: "kstore_default_stripe_size": "65536", 2023-01-25T06:18:17.129 INFO:teuthology.orchestra.run.smithi088.stdout: "kstore_fsck_on_mount": "false", 2023-01-25T06:18:17.129 INFO:teuthology.orchestra.run.smithi088.stdout: "kstore_fsck_on_mount_deep": "true", 2023-01-25T06:18:17.130 INFO:teuthology.orchestra.run.smithi088.stdout: "kstore_max_bytes": "67108864", 2023-01-25T06:18:17.130 INFO:teuthology.orchestra.run.smithi088.stdout: "kstore_max_ops": "512", 2023-01-25T06:18:17.130 INFO:teuthology.orchestra.run.smithi088.stdout: "kstore_nid_prealloc": "1024", 2023-01-25T06:18:17.130 INFO:teuthology.orchestra.run.smithi088.stdout: "kstore_onode_map_size": "1024", 2023-01-25T06:18:17.130 INFO:teuthology.orchestra.run.smithi088.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2023-01-25T06:18:17.130 INFO:teuthology.orchestra.run.smithi088.stdout: "kstore_sync_submit_transaction": "false", 2023-01-25T06:18:17.131 INFO:teuthology.orchestra.run.smithi088.stdout: "kstore_sync_transaction": "false", 2023-01-25T06:18:17.131 INFO:teuthology.orchestra.run.smithi088.stdout: "leveldb_block_size": "65536", 2023-01-25T06:18:17.131 INFO:teuthology.orchestra.run.smithi088.stdout: "leveldb_bloom_size": "0", 2023-01-25T06:18:17.131 INFO:teuthology.orchestra.run.smithi088.stdout: "leveldb_cache_size": "536870912", 2023-01-25T06:18:17.131 INFO:teuthology.orchestra.run.smithi088.stdout: "leveldb_compact_on_mount": "false", 2023-01-25T06:18:17.131 INFO:teuthology.orchestra.run.smithi088.stdout: "leveldb_compression": "false", 2023-01-25T06:18:17.132 INFO:teuthology.orchestra.run.smithi088.stdout: "leveldb_log": "", 2023-01-25T06:18:17.132 INFO:teuthology.orchestra.run.smithi088.stdout: "leveldb_log_to_ceph_log": "true", 2023-01-25T06:18:17.132 INFO:teuthology.orchestra.run.smithi088.stdout: "leveldb_max_open_files": "0", 2023-01-25T06:18:17.132 INFO:teuthology.orchestra.run.smithi088.stdout: "leveldb_paranoid": "false", 2023-01-25T06:18:17.132 INFO:teuthology.orchestra.run.smithi088.stdout: "leveldb_write_buffer_size": "33554432", 2023-01-25T06:18:17.133 INFO:teuthology.orchestra.run.smithi088.stdout: "librados_thread_count": "2", 2023-01-25T06:18:17.133 INFO:teuthology.orchestra.run.smithi088.stdout: "lockdep": "false", 2023-01-25T06:18:17.133 INFO:teuthology.orchestra.run.smithi088.stdout: "lockdep_force_backtrace": "false", 2023-01-25T06:18:17.133 INFO:teuthology.orchestra.run.smithi088.stdout: "log_coarse_timestamps": "true", 2023-01-25T06:18:17.133 INFO:teuthology.orchestra.run.smithi088.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2023-01-25T06:18:17.134 INFO:teuthology.orchestra.run.smithi088.stdout: "log_flush_on_exit": "false", 2023-01-25T06:18:17.134 INFO:teuthology.orchestra.run.smithi088.stdout: "log_graylog_host": "127.0.0.1", 2023-01-25T06:18:17.134 INFO:teuthology.orchestra.run.smithi088.stdout: "log_graylog_port": "12201", 2023-01-25T06:18:17.134 INFO:teuthology.orchestra.run.smithi088.stdout: "log_max_new": "1000", 2023-01-25T06:18:17.134 INFO:teuthology.orchestra.run.smithi088.stdout: "log_max_recent": "10000", 2023-01-25T06:18:17.135 INFO:teuthology.orchestra.run.smithi088.stdout: "log_stderr_prefix": "", 2023-01-25T06:18:17.135 INFO:teuthology.orchestra.run.smithi088.stdout: "log_stop_at_utilization": "0.970000", 2023-01-25T06:18:17.135 INFO:teuthology.orchestra.run.smithi088.stdout: "log_to_file": "true", 2023-01-25T06:18:17.135 INFO:teuthology.orchestra.run.smithi088.stdout: "log_to_graylog": "false", 2023-01-25T06:18:17.135 INFO:teuthology.orchestra.run.smithi088.stdout: "log_to_journald": "false", 2023-01-25T06:18:17.136 INFO:teuthology.orchestra.run.smithi088.stdout: "log_to_stderr": "false", 2023-01-25T06:18:17.136 INFO:teuthology.orchestra.run.smithi088.stdout: "log_to_syslog": "false", 2023-01-25T06:18:17.136 INFO:teuthology.orchestra.run.smithi088.stdout: "max_rotating_auth_attempts": "10", 2023-01-25T06:18:17.136 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_action_on_write_error": "1", 2023-01-25T06:18:17.136 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_alternate_name_max": "8192", 2023-01-25T06:18:17.137 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_asio_thread_count": "2", 2023-01-25T06:18:17.137 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_bal_export_pin": "true", 2023-01-25T06:18:17.137 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_bal_fragment_dirs": "true", 2023-01-25T06:18:17.137 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2023-01-25T06:18:17.137 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_bal_fragment_interval": "5", 2023-01-25T06:18:17.138 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_bal_fragment_size_max": "100000", 2023-01-25T06:18:17.138 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_bal_idle_threshold": "0.000000", 2023-01-25T06:18:17.138 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_bal_interval": "10", 2023-01-25T06:18:17.138 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_bal_max": "-1", 2023-01-25T06:18:17.138 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_bal_max_until": "-1", 2023-01-25T06:18:17.139 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_bal_merge_size": "50", 2023-01-25T06:18:17.139 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_bal_midchunk": "0.300000", 2023-01-25T06:18:17.139 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_bal_min_rebalance": "0.100000", 2023-01-25T06:18:17.139 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_bal_min_start": "0.200000", 2023-01-25T06:18:17.139 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_bal_minchunk": "0.001000", 2023-01-25T06:18:17.140 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_bal_mode": "0", 2023-01-25T06:18:17.140 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_bal_need_max": "1.200000", 2023-01-25T06:18:17.140 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_bal_need_min": "0.800000", 2023-01-25T06:18:17.140 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_bal_replicate_threshold": "8000.000000", 2023-01-25T06:18:17.140 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_bal_sample_interval": "3.000000", 2023-01-25T06:18:17.141 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_bal_split_bits": "3", 2023-01-25T06:18:17.141 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_bal_split_rd": "25000.000000", 2023-01-25T06:18:17.141 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_bal_split_size": "10000", 2023-01-25T06:18:17.141 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_bal_split_wr": "10000.000000", 2023-01-25T06:18:17.141 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_bal_target_decay": "10.000000", 2023-01-25T06:18:17.141 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2023-01-25T06:18:17.142 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_beacon_grace": "15.000000", 2023-01-25T06:18:17.142 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_beacon_interval": "4.000000", 2023-01-25T06:18:17.142 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_beacon_mon_down_grace": "60", 2023-01-25T06:18:17.142 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_cache_memory_limit": "4294967296", 2023-01-25T06:18:17.143 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_cache_mid": "0.700000", 2023-01-25T06:18:17.143 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_cache_release_free_interval": "10", 2023-01-25T06:18:17.143 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_cache_reservation": "0.050000", 2023-01-25T06:18:17.143 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_cache_trim_decay_rate": "1.000000", 2023-01-25T06:18:17.143 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_cache_trim_interval": "1", 2023-01-25T06:18:17.143 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_cache_trim_threshold": "262144", 2023-01-25T06:18:17.144 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2023-01-25T06:18:17.144 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2023-01-25T06:18:17.144 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_client_delegate_inos_pct": "50", 2023-01-25T06:18:17.144 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_client_prealloc_inos": "1000", 2023-01-25T06:18:17.144 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2023-01-25T06:18:17.145 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_connect_bootstrapping": "false", 2023-01-25T06:18:17.145 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_damage_table_max_entries": "10000", 2023-01-25T06:18:17.145 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2023-01-25T06:18:17.145 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_debug_auth_pins": "false", 2023-01-25T06:18:17.145 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_debug_frag": "false", 2023-01-25T06:18:17.146 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_debug_scatterstat": "false", 2023-01-25T06:18:17.146 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_debug_subtrees": "false", 2023-01-25T06:18:17.146 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_decay_halflife": "5.000000", 2023-01-25T06:18:17.146 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_default_dir_hash": "2", 2023-01-25T06:18:17.147 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_defer_session_stale": "true", 2023-01-25T06:18:17.147 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_deny_all_reconnect": "false", 2023-01-25T06:18:17.147 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_dir_keys_per_op": "16384", 2023-01-25T06:18:17.147 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_dir_max_commit_size": "10", 2023-01-25T06:18:17.147 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_dir_max_entries": "0", 2023-01-25T06:18:17.147 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_dir_prefetch": "true", 2023-01-25T06:18:17.148 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_dirstat_min_interval": "1.000000", 2023-01-25T06:18:17.148 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_dump_cache_after_rejoin": "false", 2023-01-25T06:18:17.148 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_dump_cache_on_map": "false", 2023-01-25T06:18:17.148 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_dump_cache_threshold_file": "0", 2023-01-25T06:18:17.148 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2023-01-25T06:18:17.149 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_early_reply": "true", 2023-01-25T06:18:17.149 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_enable_op_tracker": "true", 2023-01-25T06:18:17.149 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_enforce_unique_name": "true", 2023-01-25T06:18:17.149 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_export_ephemeral_distributed": "true", 2023-01-25T06:18:17.149 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2023-01-25T06:18:17.149 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_export_ephemeral_random": "true", 2023-01-25T06:18:17.150 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_export_ephemeral_random_max": "0.010000", 2023-01-25T06:18:17.150 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_extraordinary_events_dump_interval": "0", 2023-01-25T06:18:17.150 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_forward_all_requests_to_auth": "false", 2023-01-25T06:18:17.150 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_freeze_tree_timeout": "30.000000", 2023-01-25T06:18:17.150 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_fscrypt_last_block_max_size": "4096", 2023-01-25T06:18:17.151 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2023-01-25T06:18:17.151 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_health_cache_threshold": "1.500000", 2023-01-25T06:18:17.151 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_health_summarize_threshold": "10", 2023-01-25T06:18:17.151 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_heartbeat_grace": "15.000000", 2023-01-25T06:18:17.151 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_heartbeat_reset_grace": "1000", 2023-01-25T06:18:17.151 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_inject_health_dummy": "false", 2023-01-25T06:18:17.152 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_inject_migrator_session_race": "false", 2023-01-25T06:18:17.152 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2023-01-25T06:18:17.152 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_join_fs": "", 2023-01-25T06:18:17.152 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_journal_format": "1", 2023-01-25T06:18:17.152 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_kill_create_at": "0", 2023-01-25T06:18:17.153 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_kill_export_at": "0", 2023-01-25T06:18:17.153 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_kill_import_at": "0", 2023-01-25T06:18:17.153 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_kill_journal_at": "0", 2023-01-25T06:18:17.153 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_kill_journal_expire_at": "0", 2023-01-25T06:18:17.153 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_kill_journal_replay_at": "0", 2023-01-25T06:18:17.154 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_kill_link_at": "0", 2023-01-25T06:18:17.154 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_kill_mdstable_at": "0", 2023-01-25T06:18:17.154 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_kill_openc_at": "0", 2023-01-25T06:18:17.154 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_kill_rename_at": "0", 2023-01-25T06:18:17.154 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_log_events_per_segment": "1024", 2023-01-25T06:18:17.155 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_log_max_events": "-1", 2023-01-25T06:18:17.155 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_log_max_segments": "128", 2023-01-25T06:18:17.155 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_log_pause": "false", 2023-01-25T06:18:17.155 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_log_segment_size": "0", 2023-01-25T06:18:17.155 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_log_skip_corrupt_events": "false", 2023-01-25T06:18:17.156 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_log_warn_factor": "2.000000", 2023-01-25T06:18:17.156 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_max_caps_per_client": "1048576", 2023-01-25T06:18:17.156 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_max_completed_flushes": "100000", 2023-01-25T06:18:17.156 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_max_completed_requests": "100000", 2023-01-25T06:18:17.156 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_max_export_size": "20971520", 2023-01-25T06:18:17.157 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_max_file_recover": "32", 2023-01-25T06:18:17.157 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_max_purge_files": "64", 2023-01-25T06:18:17.157 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_max_purge_ops": "8192", 2023-01-25T06:18:17.157 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2023-01-25T06:18:17.158 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_max_retries_on_remount_failure": "5", 2023-01-25T06:18:17.158 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_max_scrub_ops_in_progress": "5", 2023-01-25T06:18:17.158 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_max_snaps_per_dir": "100", 2023-01-25T06:18:17.158 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_max_xattr_pairs_size": "65536", 2023-01-25T06:18:17.158 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_metrics_update_interval": "2", 2023-01-25T06:18:17.159 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_min_caps_per_client": "100", 2023-01-25T06:18:17.159 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_min_caps_working_set": "10000", 2023-01-25T06:18:17.159 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_mon_shutdown_timeout": "5.000000", 2023-01-25T06:18:17.159 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_numa_node": "-1", 2023-01-25T06:18:17.159 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_oft_prefetch_dirfrags": "false", 2023-01-25T06:18:17.160 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_op_complaint_time": "30.000000", 2023-01-25T06:18:17.160 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_op_history_duration": "600", 2023-01-25T06:18:17.160 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_op_history_size": "20", 2023-01-25T06:18:17.160 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_op_log_threshold": "5", 2023-01-25T06:18:17.161 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_ping_grace": "15", 2023-01-25T06:18:17.161 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_ping_interval": "5", 2023-01-25T06:18:17.161 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2023-01-25T06:18:17.161 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_recall_global_max_decay_threshold": "131072", 2023-01-25T06:18:17.162 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_recall_max_caps": "30000", 2023-01-25T06:18:17.162 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_recall_max_decay_rate": "1.500000", 2023-01-25T06:18:17.162 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_recall_max_decay_threshold": "131072", 2023-01-25T06:18:17.162 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_recall_warning_decay_rate": "60.000000", 2023-01-25T06:18:17.163 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_recall_warning_threshold": "262144", 2023-01-25T06:18:17.163 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_reconnect_timeout": "45.000000", 2023-01-25T06:18:17.163 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_replay_interval": "1.000000", 2023-01-25T06:18:17.164 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_replay_unsafe_with_closed_session": "false", 2023-01-25T06:18:17.164 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_request_load_average_decay_rate": "60.000000", 2023-01-25T06:18:17.164 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_root_ino_gid": "0", 2023-01-25T06:18:17.164 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_root_ino_uid": "0", 2023-01-25T06:18:17.164 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_scatter_nudge_interval": "5.000000", 2023-01-25T06:18:17.164 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_session_blocklist_on_evict": "true", 2023-01-25T06:18:17.165 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_session_blocklist_on_timeout": "true", 2023-01-25T06:18:17.165 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2023-01-25T06:18:17.165 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_session_cache_liveness_magnitude": "10", 2023-01-25T06:18:17.165 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_session_cap_acquisition_decay_rate": "10.000000", 2023-01-25T06:18:17.165 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_session_cap_acquisition_throttle": "500000", 2023-01-25T06:18:17.166 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2023-01-25T06:18:17.166 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_sessionmap_keys_per_op": "1024", 2023-01-25T06:18:17.166 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_shutdown_check": "0", 2023-01-25T06:18:17.166 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_skip_ino": "0", 2023-01-25T06:18:17.166 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_sleep_rank_change": "0.000000", 2023-01-25T06:18:17.167 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_snap_max_uid": "4294967294", 2023-01-25T06:18:17.167 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_snap_min_uid": "0", 2023-01-25T06:18:17.167 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_snap_rstat": "false", 2023-01-25T06:18:17.167 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_standby_replay_damaged": "false", 2023-01-25T06:18:17.167 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_symlink_recovery": "true", 2023-01-25T06:18:17.168 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_task_status_update_interval": "2.000000", 2023-01-25T06:18:17.168 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_thrash_exports": "0", 2023-01-25T06:18:17.168 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_thrash_fragments": "0", 2023-01-25T06:18:17.168 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_tick_interval": "5.000000", 2023-01-25T06:18:17.168 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_valgrind_exit": "false", 2023-01-25T06:18:17.169 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_verify_backtrace": "1", 2023-01-25T06:18:17.169 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_verify_scatter": "false", 2023-01-25T06:18:17.169 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_wipe_ino_prealloc": "false", 2023-01-25T06:18:17.169 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_wipe_sessions": "false", 2023-01-25T06:18:17.169 INFO:teuthology.orchestra.run.smithi088.stdout: "mempool_debug": "false", 2023-01-25T06:18:17.170 INFO:teuthology.orchestra.run.smithi088.stdout: "memstore_debug_omit_block_device_write": "false", 2023-01-25T06:18:17.170 INFO:teuthology.orchestra.run.smithi088.stdout: "memstore_device_bytes": "1073741824", 2023-01-25T06:18:17.170 INFO:teuthology.orchestra.run.smithi088.stdout: "memstore_page_set": "false", 2023-01-25T06:18:17.170 INFO:teuthology.orchestra.run.smithi088.stdout: "memstore_page_size": "65536", 2023-01-25T06:18:17.170 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr_client_bytes": "134217728", 2023-01-25T06:18:17.171 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr_client_messages": "512", 2023-01-25T06:18:17.171 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2023-01-25T06:18:17.171 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr_connect_retry_interval": "1.000000", 2023-01-25T06:18:17.171 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2023-01-25T06:18:17.171 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2023-01-25T06:18:17.172 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr_disabled_modules": "", 2023-01-25T06:18:17.172 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr_initial_modules": "restful iostat nfs", 2023-01-25T06:18:17.172 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr_max_pg_num_change": "128", 2023-01-25T06:18:17.172 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr_mds_bytes": "134217728", 2023-01-25T06:18:17.172 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr_mds_messages": "128", 2023-01-25T06:18:17.172 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2023-01-25T06:18:17.173 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr_mon_bytes": "134217728", 2023-01-25T06:18:17.173 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr_mon_messages": "128", 2023-01-25T06:18:17.173 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr_osd_bytes": "536870912", 2023-01-25T06:18:17.173 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr_osd_messages": "8192", 2023-01-25T06:18:17.173 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr_pool": "true", 2023-01-25T06:18:17.174 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr_service_beacon_grace": "60.000000", 2023-01-25T06:18:17.174 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr_standby_modules": "true", 2023-01-25T06:18:17.174 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr_stats_period": "5", 2023-01-25T06:18:17.174 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr_stats_threshold": "5", 2023-01-25T06:18:17.174 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr_tick_period": "2", 2023-01-25T06:18:17.175 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr_ttl_cache_expire_seconds": "0", 2023-01-25T06:18:17.175 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_accept_timeout_factor": "2.000000", 2023-01-25T06:18:17.175 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_allow_pool_delete": "true", 2023-01-25T06:18:17.175 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_allow_pool_size_one": "true", 2023-01-25T06:18:17.176 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_auth_validate_all_caps": "true", 2023-01-25T06:18:17.176 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2023-01-25T06:18:17.176 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2023-01-25T06:18:17.176 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_client_bytes": "104857600", 2023-01-25T06:18:17.176 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_client_directed_command_retry": "2", 2023-01-25T06:18:17.177 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_client_hunt_interval": "3.000000", 2023-01-25T06:18:17.177 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2023-01-25T06:18:17.177 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2023-01-25T06:18:17.177 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2023-01-25T06:18:17.177 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_client_hunt_parallel": "3", 2023-01-25T06:18:17.177 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_client_log_interval": "1.000000", 2023-01-25T06:18:17.178 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_client_max_log_entries_per_message": "1000", 2023-01-25T06:18:17.178 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_client_ping_interval": "10.000000", 2023-01-25T06:18:17.178 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_client_ping_timeout": "30.000000", 2023-01-25T06:18:17.178 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_clock_drift_allowed": "1.000000", 2023-01-25T06:18:17.178 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2023-01-25T06:18:17.179 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2023-01-25T06:18:17.179 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_cluster_log_file_level": "debug", 2023-01-25T06:18:17.179 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_cluster_log_to_file": "true", 2023-01-25T06:18:17.179 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_cluster_log_to_graylog": "false", 2023-01-25T06:18:17.179 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2023-01-25T06:18:17.179 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_cluster_log_to_graylog_port": "12201", 2023-01-25T06:18:17.180 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_cluster_log_to_journald": "false", 2023-01-25T06:18:17.180 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_cluster_log_to_stderr": "false", 2023-01-25T06:18:17.180 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_cluster_log_to_syslog": "default=false", 2023-01-25T06:18:17.180 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2023-01-25T06:18:17.180 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_cluster_log_to_syslog_level": "info", 2023-01-25T06:18:17.181 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_compact_on_bootstrap": "false", 2023-01-25T06:18:17.181 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_compact_on_start": "false", 2023-01-25T06:18:17.181 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_compact_on_trim": "true", 2023-01-25T06:18:17.181 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_con_tracker_persist_interval": "10", 2023-01-25T06:18:17.181 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_con_tracker_score_halflife": "43200", 2023-01-25T06:18:17.182 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_config_key_max_entry_size": "65536", 2023-01-25T06:18:17.182 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_cpu_threads": "4", 2023-01-25T06:18:17.182 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_crush_min_required_version": "hammer", 2023-01-25T06:18:17.182 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_daemon_bytes": "419430400", 2023-01-25T06:18:17.182 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2023-01-25T06:18:17.182 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_data_avail_crit": "5", 2023-01-25T06:18:17.183 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_data_avail_warn": "5", 2023-01-25T06:18:17.183 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_data_size_warn": "16106127360", 2023-01-25T06:18:17.183 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_debug_block_osdmap_trim": "false", 2023-01-25T06:18:17.183 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_debug_deprecated_as_obsolete": "false", 2023-01-25T06:18:17.183 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_debug_dump_json": "false", 2023-01-25T06:18:17.184 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2023-01-25T06:18:17.184 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_debug_dump_transactions": "false", 2023-01-25T06:18:17.184 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_debug_extra_checks": "false", 2023-01-25T06:18:17.184 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_debug_no_initial_persistent_features": "false", 2023-01-25T06:18:17.184 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2023-01-25T06:18:17.185 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_debug_no_require_quincy": "false", 2023-01-25T06:18:17.185 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_debug_no_require_reef": "false", 2023-01-25T06:18:17.185 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2023-01-25T06:18:17.185 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_delta_reset_interval": "10.000000", 2023-01-25T06:18:17.185 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_dns_srv_name": "ceph-mon", 2023-01-25T06:18:17.185 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_down_mkfs_grace": "120", 2023-01-25T06:18:17.186 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_election_default_strategy": "1", 2023-01-25T06:18:17.186 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_election_timeout": "5.000000", 2023-01-25T06:18:17.186 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2023-01-25T06:18:17.186 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_elector_ping_divisor": "2", 2023-01-25T06:18:17.186 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_elector_ping_timeout": "2.000000", 2023-01-25T06:18:17.187 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_enable_op_tracker": "true", 2023-01-25T06:18:17.187 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_fake_pool_delete": "false", 2023-01-25T06:18:17.187 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_force_quorum_join": "false", 2023-01-25T06:18:17.187 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_globalid_prealloc": "10000", 2023-01-25T06:18:17.187 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_health_detail_to_clog": "false", 2023-01-25T06:18:17.188 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_health_log_update_period": "5", 2023-01-25T06:18:17.188 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_health_max_detail": "50", 2023-01-25T06:18:17.188 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_health_to_clog": "true", 2023-01-25T06:18:17.188 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_health_to_clog_interval": "600", 2023-01-25T06:18:17.188 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2023-01-25T06:18:17.189 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_host": "172.21.15.88,[v2:172.21.15.88:3301,v1:172.21.15.88:6790],172.21.15.89", 2023-01-25T06:18:17.189 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_host_override": "", 2023-01-25T06:18:17.189 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_initial_members": "", 2023-01-25T06:18:17.189 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2023-01-25T06:18:17.189 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2023-01-25T06:18:17.190 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_inject_transaction_delay_max": "10.000000", 2023-01-25T06:18:17.190 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2023-01-25T06:18:17.190 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_keyvaluedb": "rocksdb", 2023-01-25T06:18:17.190 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_lease": "5.000000", 2023-01-25T06:18:17.190 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2023-01-25T06:18:17.191 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_lease_renew_interval_factor": "0.600000", 2023-01-25T06:18:17.191 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_log_full_interval": "50", 2023-01-25T06:18:17.191 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_log_max": "10000", 2023-01-25T06:18:17.191 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_log_max_summary": "50", 2023-01-25T06:18:17.191 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_max_log_entries_per_event": "4096", 2023-01-25T06:18:17.192 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_max_log_epochs": "500", 2023-01-25T06:18:17.192 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_max_mdsmap_epochs": "500", 2023-01-25T06:18:17.192 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_max_mgrmap_epochs": "500", 2023-01-25T06:18:17.192 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_max_osd": "10000", 2023-01-25T06:18:17.192 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_max_pg_per_osd": "10000", 2023-01-25T06:18:17.193 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_max_pool_pg_num": "65536", 2023-01-25T06:18:17.193 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_max_snap_prune_per_epoch": "100", 2023-01-25T06:18:17.193 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_mds_blocklist_interval": "86400.000000", 2023-01-25T06:18:17.193 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_mds_force_trim_to": "0", 2023-01-25T06:18:17.194 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_mds_skip_sanity": "false", 2023-01-25T06:18:17.194 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_memory_autotune": "true", 2023-01-25T06:18:17.194 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_memory_target": "2147483648", 2023-01-25T06:18:17.194 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_mgr_beacon_grace": "30", 2023-01-25T06:18:17.194 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2023-01-25T06:18:17.195 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_mgr_digest_period": "5", 2023-01-25T06:18:17.195 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_mgr_inactive_grace": "60", 2023-01-25T06:18:17.195 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_mgr_mkfs_grace": "240", 2023-01-25T06:18:17.195 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2023-01-25T06:18:17.195 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_min_osdmap_epochs": "50", 2023-01-25T06:18:17.195 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_op_complaint_time": "30", 2023-01-25T06:18:17.196 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_op_history_duration": "600", 2023-01-25T06:18:17.196 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_op_history_size": "20", 2023-01-25T06:18:17.196 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_op_history_slow_op_size": "20", 2023-01-25T06:18:17.196 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_op_history_slow_op_threshold": "10", 2023-01-25T06:18:17.196 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_op_log_threshold": "5", 2023-01-25T06:18:17.197 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_adjust_down_out_interval": "true", 2023-01-25T06:18:17.197 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2023-01-25T06:18:17.197 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2023-01-25T06:18:17.197 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_auto_mark_in": "false", 2023-01-25T06:18:17.197 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_auto_mark_new_in": "true", 2023-01-25T06:18:17.198 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2023-01-25T06:18:17.198 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2023-01-25T06:18:17.198 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_cache_size": "500", 2023-01-25T06:18:17.198 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_cache_size_min": "134217728", 2023-01-25T06:18:17.198 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_crush_smoke_test": "true", 2023-01-25T06:18:17.198 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_destroyed_out_interval": "600", 2023-01-25T06:18:17.199 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_down_out_interval": "600", 2023-01-25T06:18:17.199 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_down_out_subtree_limit": "rack", 2023-01-25T06:18:17.199 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2023-01-25T06:18:17.199 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_force_trim_to": "0", 2023-01-25T06:18:17.199 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_full_ratio": "0.950000", 2023-01-25T06:18:17.200 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2023-01-25T06:18:17.200 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_laggy_halflife": "3600", 2023-01-25T06:18:17.200 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_laggy_max_interval": "300", 2023-01-25T06:18:17.200 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_laggy_weight": "0.300000", 2023-01-25T06:18:17.200 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2023-01-25T06:18:17.201 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_max_creating_pgs": "1024", 2023-01-25T06:18:17.201 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_max_initial_pgs": "1024", 2023-01-25T06:18:17.201 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_min_down_reporters": "2", 2023-01-25T06:18:17.201 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_min_in_ratio": "0.750000", 2023-01-25T06:18:17.201 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_min_up_ratio": "0.300000", 2023-01-25T06:18:17.201 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_nearfull_ratio": "0.850000", 2023-01-25T06:18:17.202 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_prime_pg_temp": "true", 2023-01-25T06:18:17.202 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2023-01-25T06:18:17.202 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2023-01-25T06:18:17.202 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_report_timeout": "900", 2023-01-25T06:18:17.202 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_reporter_subtree_level": "osd", 2023-01-25T06:18:17.203 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2023-01-25T06:18:17.203 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_warn_num_repaired": "10", 2023-01-25T06:18:17.203 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osd_warn_op_age": "32.000000", 2023-01-25T06:18:17.203 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osdmap_full_prune_enabled": "true", 2023-01-25T06:18:17.203 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osdmap_full_prune_interval": "2", 2023-01-25T06:18:17.204 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osdmap_full_prune_min": "15", 2023-01-25T06:18:17.204 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_osdmap_full_prune_txsize": "2", 2023-01-25T06:18:17.204 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2023-01-25T06:18:17.204 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_pg_stuck_threshold": "60", 2023-01-25T06:18:17.205 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2023-01-25T06:18:17.205 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_pg_warn_min_objects": "10000", 2023-01-25T06:18:17.205 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_pg_warn_min_per_osd": "0", 2023-01-25T06:18:17.205 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_pg_warn_min_pool_objects": "1000", 2023-01-25T06:18:17.205 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_pool_quota_crit_threshold": "0", 2023-01-25T06:18:17.206 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_pool_quota_warn_threshold": "0", 2023-01-25T06:18:17.206 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_probe_timeout": "2.000000", 2023-01-25T06:18:17.206 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_reweight_max_change": "0.050000", 2023-01-25T06:18:17.206 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_reweight_max_osds": "4", 2023-01-25T06:18:17.206 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_reweight_min_bytes_per_osd": "10", 2023-01-25T06:18:17.207 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_reweight_min_pgs_per_osd": "4", 2023-01-25T06:18:17.207 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2023-01-25T06:18:17.207 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2023-01-25T06:18:17.207 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2023-01-25T06:18:17.207 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_scrub_interval": "300", 2023-01-25T06:18:17.207 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_scrub_max_keys": "100", 2023-01-25T06:18:17.208 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_scrub_timeout": "300", 2023-01-25T06:18:17.208 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_session_timeout": "300", 2023-01-25T06:18:17.208 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_smart_report_timeout": "5", 2023-01-25T06:18:17.208 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_stat_smooth_intervals": "6", 2023-01-25T06:18:17.208 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2023-01-25T06:18:17.209 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_stretch_pool_min_size": "2", 2023-01-25T06:18:17.209 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_stretch_pool_size": "4", 2023-01-25T06:18:17.209 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2023-01-25T06:18:17.209 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_subscribe_interval": "86400.000000", 2023-01-25T06:18:17.209 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_sync_debug": "false", 2023-01-25T06:18:17.210 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_sync_max_payload_keys": "2000", 2023-01-25T06:18:17.210 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_sync_max_payload_size": "1048576", 2023-01-25T06:18:17.210 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_sync_provider_kill_at": "0", 2023-01-25T06:18:17.210 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_sync_requester_kill_at": "0", 2023-01-25T06:18:17.210 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_sync_timeout": "60.000000", 2023-01-25T06:18:17.211 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_target_pg_per_osd": "100", 2023-01-25T06:18:17.211 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_tick_interval": "5", 2023-01-25T06:18:17.211 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_timecheck_interval": "300.000000", 2023-01-25T06:18:17.211 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_timecheck_skew_interval": "30.000000", 2023-01-25T06:18:17.211 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_use_min_delay_socket": "false", 2023-01-25T06:18:17.211 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_warn_older_version_delay": "604800", 2023-01-25T06:18:17.212 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2023-01-25T06:18:17.212 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2023-01-25T06:18:17.212 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2023-01-25T06:18:17.212 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_warn_on_filestore_osds": "false", 2023-01-25T06:18:17.212 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2023-01-25T06:18:17.213 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2023-01-25T06:18:17.213 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2023-01-25T06:18:17.213 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_warn_on_misplaced": "false", 2023-01-25T06:18:17.213 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2023-01-25T06:18:17.213 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_warn_on_older_version": "true", 2023-01-25T06:18:17.214 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2023-01-25T06:18:17.214 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_warn_on_pool_no_app": "true", 2023-01-25T06:18:17.214 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_warn_on_pool_no_redundancy": "false", 2023-01-25T06:18:17.214 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2023-01-25T06:18:17.214 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2023-01-25T06:18:17.215 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2023-01-25T06:18:17.215 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_warn_on_too_few_osds": "false", 2023-01-25T06:18:17.215 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2023-01-25T06:18:17.215 INFO:teuthology.orchestra.run.smithi088.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2023-01-25T06:18:17.215 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": "", 2023-01-25T06:18:17.216 INFO:teuthology.orchestra.run.smithi088.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2023-01-25T06:18:17.216 INFO:teuthology.orchestra.run.smithi088.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2023-01-25T06:18:17.216 INFO:teuthology.orchestra.run.smithi088.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2023-01-25T06:18:17.216 INFO:teuthology.orchestra.run.smithi088.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2023-01-25T06:18:17.216 INFO:teuthology.orchestra.run.smithi088.stdout: "motr_tracing_enabled": "false", 2023-01-25T06:18:17.217 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_async_op_threads": "3", 2023-01-25T06:18:17.217 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_async_rdma_buffer_size": "131072", 2023-01-25T06:18:17.217 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_async_rdma_cm": "false", 2023-01-25T06:18:17.217 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_async_rdma_device_name": "", 2023-01-25T06:18:17.217 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_async_rdma_dscp": "96", 2023-01-25T06:18:17.218 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_async_rdma_enable_hugepage": "false", 2023-01-25T06:18:17.218 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_async_rdma_gid_idx": "0", 2023-01-25T06:18:17.218 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_async_rdma_local_gid": "", 2023-01-25T06:18:17.218 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_async_rdma_polling_us": "1000", 2023-01-25T06:18:17.218 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_async_rdma_port_num": "1", 2023-01-25T06:18:17.219 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_async_rdma_receive_buffers": "32768", 2023-01-25T06:18:17.219 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_async_rdma_receive_queue_len": "4096", 2023-01-25T06:18:17.219 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_async_rdma_roce_ver": "1", 2023-01-25T06:18:17.219 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_async_rdma_send_buffers": "1024", 2023-01-25T06:18:17.219 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_async_rdma_sl": "3", 2023-01-25T06:18:17.219 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_async_rdma_support_srq": "true", 2023-01-25T06:18:17.220 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_async_rdma_type": "ib", 2023-01-25T06:18:17.220 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_async_reap_threshold": "5", 2023-01-25T06:18:17.220 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_bind_before_connect": "false", 2023-01-25T06:18:17.220 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_bind_ipv4": "true", 2023-01-25T06:18:17.220 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_bind_ipv6": "false", 2023-01-25T06:18:17.221 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_bind_msgr1": "true", 2023-01-25T06:18:17.221 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_bind_msgr2": "true", 2023-01-25T06:18:17.221 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_bind_port_max": "7568", 2023-01-25T06:18:17.221 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_bind_port_min": "6800", 2023-01-25T06:18:17.221 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_bind_prefer_ipv4": "false", 2023-01-25T06:18:17.222 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_bind_retry_count": "3", 2023-01-25T06:18:17.222 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_bind_retry_delay": "5", 2023-01-25T06:18:17.222 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_blackhole_client": "false", 2023-01-25T06:18:17.222 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_blackhole_mds": "false", 2023-01-25T06:18:17.222 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_blackhole_mgr": "false", 2023-01-25T06:18:17.223 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_blackhole_mon": "false", 2023-01-25T06:18:17.223 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_blackhole_osd": "false", 2023-01-25T06:18:17.223 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_client_mode": "crc secure", 2023-01-25T06:18:17.223 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_cluster_mode": "crc secure", 2023-01-25T06:18:17.223 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_cluster_type": "", 2023-01-25T06:18:17.224 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_compress_secure": "false", 2023-01-25T06:18:17.224 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_connection_idle_timeout": "900", 2023-01-25T06:18:17.224 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_connection_ready_timeout": "10", 2023-01-25T06:18:17.224 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_crc_data": "true", 2023-01-25T06:18:17.224 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_crc_header": "true", 2023-01-25T06:18:17.224 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_die_on_bad_msg": "false", 2023-01-25T06:18:17.225 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_die_on_bug": "true", 2023-01-25T06:18:17.225 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_die_on_old_message": "true", 2023-01-25T06:18:17.225 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_die_on_skipped_message": "false", 2023-01-25T06:18:17.225 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_die_on_unhandled_msg": "false", 2023-01-25T06:18:17.225 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_dispatch_throttle_bytes": "104857600", 2023-01-25T06:18:17.226 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_dpdk_coremask": "0xF", 2023-01-25T06:18:17.226 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_dpdk_debug_allow_loopback": "false", 2023-01-25T06:18:17.226 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_dpdk_devs_allowlist": "", 2023-01-25T06:18:17.226 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_dpdk_enable_tso": "true", 2023-01-25T06:18:17.226 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2023-01-25T06:18:17.227 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_dpdk_host_ipv4_addr": "", 2023-01-25T06:18:17.227 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_dpdk_hugepages": "", 2023-01-25T06:18:17.227 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_dpdk_hw_flow_control": "true", 2023-01-25T06:18:17.227 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2023-01-25T06:18:17.227 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_dpdk_lro": "true", 2023-01-25T06:18:17.228 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_dpdk_memory_channel": "4", 2023-01-25T06:18:17.228 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2023-01-25T06:18:17.228 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_dpdk_pmd": "", 2023-01-25T06:18:17.228 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_dpdk_port_id": "0", 2023-01-25T06:18:17.228 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2023-01-25T06:18:17.229 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_dump_corrupt_message_level": "1", 2023-01-25T06:18:17.229 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_dump_on_send": "false", 2023-01-25T06:18:17.229 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_initial_backoff": "0.200000", 2023-01-25T06:18:17.229 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_inject_delay_max": "1.000000", 2023-01-25T06:18:17.229 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_inject_delay_probability": "0.000000", 2023-01-25T06:18:17.229 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_inject_delay_type": "", 2023-01-25T06:18:17.230 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_inject_internal_delays": "0.000000", 2023-01-25T06:18:17.230 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_inject_network_congestion": "0", 2023-01-25T06:18:17.230 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_inject_socket_failures": "0", 2023-01-25T06:18:17.230 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_learn_addr_from_peer": "true", 2023-01-25T06:18:17.230 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_max_accept_failures": "4", 2023-01-25T06:18:17.231 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_max_backoff": "15.000000", 2023-01-25T06:18:17.231 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_mon_client_mode": "secure crc", 2023-01-25T06:18:17.231 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_mon_cluster_mode": "secure crc", 2023-01-25T06:18:17.231 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_mon_service_mode": "secure crc", 2023-01-25T06:18:17.231 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_osd_compress_min_size": "1024", 2023-01-25T06:18:17.232 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_osd_compress_mode": "none", 2023-01-25T06:18:17.232 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_osd_compression_algorithm": "snappy zlib zstd lz4", 2023-01-25T06:18:17.232 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2023-01-25T06:18:17.232 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_pq_min_cost": "65536", 2023-01-25T06:18:17.232 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_public_type": "", 2023-01-25T06:18:17.233 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_service_mode": "crc secure", 2023-01-25T06:18:17.233 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_tcp_listen_backlog": "512", 2023-01-25T06:18:17.233 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_tcp_nodelay": "true", 2023-01-25T06:18:17.233 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_tcp_prefetch_max_size": "4096", 2023-01-25T06:18:17.233 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_tcp_rcvbuf": "0", 2023-01-25T06:18:17.234 INFO:teuthology.orchestra.run.smithi088.stdout: "ms_type": "async", 2023-01-25T06:18:17.234 INFO:teuthology.orchestra.run.smithi088.stdout: "no_config_file": "false", 2023-01-25T06:18:17.234 INFO:teuthology.orchestra.run.smithi088.stdout: "objecter_completion_locks_per_session": "32", 2023-01-25T06:18:17.234 INFO:teuthology.orchestra.run.smithi088.stdout: "objecter_debug_inject_relock_delay": "false", 2023-01-25T06:18:17.234 INFO:teuthology.orchestra.run.smithi088.stdout: "objecter_inflight_op_bytes": "104857600", 2023-01-25T06:18:17.234 INFO:teuthology.orchestra.run.smithi088.stdout: "objecter_inflight_ops": "1024", 2023-01-25T06:18:17.235 INFO:teuthology.orchestra.run.smithi088.stdout: "objecter_inject_no_watch_ping": "false", 2023-01-25T06:18:17.235 INFO:teuthology.orchestra.run.smithi088.stdout: "objecter_retry_writes_after_first_reply": "false", 2023-01-25T06:18:17.235 INFO:teuthology.orchestra.run.smithi088.stdout: "objecter_tick_interval": "5.000000", 2023-01-25T06:18:17.235 INFO:teuthology.orchestra.run.smithi088.stdout: "objecter_timeout": "10.000000", 2023-01-25T06:18:17.235 INFO:teuthology.orchestra.run.smithi088.stdout: "objectstore_blackhole": "false", 2023-01-25T06:18:17.236 INFO:teuthology.orchestra.run.smithi088.stdout: "openssl_engine_opts": "", 2023-01-25T06:18:17.236 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_agent_delay_time": "5.000000", 2023-01-25T06